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The  fascination  with  artificial  intelligence  (Al)  predates  the  electronic 

computer.  In  the  1800s  a  mechanical  chess-playing  robot  was  developed  and 

A 

enjoyed  some  brief  success  until  it  was  discovered  that  a  midget  was 

concealed  inside  the  mechanism.  AVh+tej  advances  in  electronic  technology 

have  permitted  increasing  sophistication  in  hiding  the  human  in  the  , 

b 

mechanism,  there  is  still  a  substantial  carnival  element  of  conning  the  ru^es 
associated  with  the  application  of  computer  technology— especially  in  the 
adaptation  of  terminology.  As  one  software  manager  was  quoted  in  a  recent 
issue  of  the  Applied  Artificial  Intelligence  Reporter:  "Before  long,  anything 
that  contains  a  slick  algorithm  will  be  declared  to  possess  Al." 


INPUT'S  poll  to  determine  what  would  be  covered  in  this  report  was  unanimous  <?w 
in  stating -thq^  def initions/find^inderstanding  ■werc-ncededyjf  what  constitute^ 
specif  icall^jlow  expertAor  knowledge-basea^systems  w«*^"different" 

■frnm  u/hnt  wris  nlrpnHy  hninn  Hnna  in  <r.mg  nr\\/nnnnr\  plnnninn  nnrl  npnrnf}nnn\^ 

■ny^tems  whirh  nlr^nHy  ftxjgtpH.  ecvvn^^t^jjl  c\-a£Ta 

In  addition,  several  very  pragmatic  questions  were  raised  such  as:  '^°w  much 
in  it  (export  cyi?tiams)  be  eost^justif  ied?"  Botrfvery  good  quest ionsAespectcdly<L' 

-fTtTr-Q  nnhnAy  ron||y  ■  ■ng'pi-qtrinrl  whnt  nil  thp  ^y^jtpmpnt  is  nhrti  it  pyr-ppt  thnt 
Future  and  Dminonr,  WranU  are  writing  nrtirlps  about  expert  systems  nnd, 
memjyei'hel'il  [fTTeTesi  cannot  be  far  behind.- 
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The  purpose  of  this  study  is  to  answer  st 


rl  questions  to  the  beat  of 


mir -ability  with  special  emphasis  upon  anticipated  problems.  Areas  to  be 
covered  included: 


Al  and  expert  systemsfcHyefinitionsJ1?^  \  Q 


Al  and  operations  research  (OR)£?affinities. 


21a* 


Hardwarej^software|human^onsiderations-a«d^costs. 
Quality  assurance  (QA)^ini  plications. 
[Applications  and  domains(  explained. 


^//Tntormation  systems 


The  methodology  employed  in  developing  this, report  was  to  review  og  much 

information^  Hniu  would  pormtt,^talk  to  a  few  knowledgeable  people,  and  -jt> 

reachnrvtuitTv^^onclusions^  In  other  words,  this  produc^ contains  all  natural 

intelligence  without  any  artificial  flowing,  preservatives,  or  supplements. 

Taken  with  reasonable  exercize  of  your  own  natural  intelligence,  it  should  tee^ 

\[  P  ywf 

benef isia4  ^  both  your  personal  and^orporate  health  and  welfare. 

ft   u*i  U   V»«.  ^pl^e  9^^;^  a^^"  lxk 
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EXECUTIVE  SUMMARY 


This  executive  summary  is  designed  in  presentation  format  in  order  to: 


Help  the  reader  review  the  key  research  findings. 


Provide  a  general  presentation  and  script  to  facilitate  group 
communications. 

The  key  points  of  the  entire  report  are  summarized  in  Exhibi^ll-I  through 
11-5.  On  the  left-hand  page  facing  each  exhibit  is  a  script  explaining  the 
exhibil^contents. 


The  entire  field  of  Artificial  Intelligence  is  shrouded  in  controversy,  and 
reseach  and  development  is  bounded  by  the  loading  edge  of  many  disciplines^ 
including  computer "Sepv+ee^  In  many  ways  this  report  is  like  the  first  version 
of  an  expert  system,  and  the  executive  summary  represents  only  the  surface 
of  a  complex  subjecf~-The  reader  is-wgedjto  understand^the  bounds  of  4?*^ 
domain. 
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«€ERT  A1NTY  AM>4J^EHTAINTY--^ 


When^Babbage  conceived  the  Analytical  ^gine,-l=9^Lovelace^observed  that 
there  was  a  natural  tendency  to  first  overrate  and  then  undervalue  all  such 
developments.  This  is  perhaps  the  most  profound  observation  ever  made 
concerning  computer  technology. 

Consider  all  the  solutions  and  final  answers  t^o  systems  development -such 
-es^COBOL,  Data  Base  Management  Systems,  Structured  Programming, 
Fourth^Generation  Languages,  etc.'dall  have  gone, -ancLare  going,  through 
some  phase  of  Lady  Lovelace's  cycled 


It  is  a  certain^/that  artificial  intelligence  and  expert  systems  will  be  subject 
to  the  same  cycle,  but  uncertainty  arises  in  determining  exactly  where  we  are 
in  the  cycle. 


Expert  systems,  unlike  traditional  data  processing  systems,  deal  with 
uncertainty— with  those  "maybe^  wonder"  problems -^^^^have  no  specific 
solution^rather  than  the  straightforward^simplicity  of  accounting  type 
^•w^eb^lead  themselves  to  ^es^no'*fsolutions. 


problems^ 


Confronted  with  uncertainty,  it  is  certain  that  both  humans  and  expert 


systems  will  reach  varying  solutions  to  the  same  problem.  Establishing 
probabilities  associated  with  the  quality  of  such  solutions  is-certainlya 
difficult  problem. 
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B. 


DATMNFORMATION/KNOWLEDGE 


f 


Data  are  facts  and  a  great  deal  of  progress  has  been  made  in  storing  data  on 

■Per 

electronic  media  for  processing  and^access  by  computers. 

Information  is  the  result  of  analysis  and  may  be  based  on  -be+W^facts  and/or 
opinions.  It  is  normally  stored  on  paper-^in^e+tSe^ile  cabinets  or  libraries. 
Office  automation  is  concerned  primarily  with  the  movement  of  information 
from  paper  to  electronic  media  where  it  can  be  more  readily  processed, 
formatted,  and  accessed.  Despite  some  progress,  most  information  continues 
to  be  stored  on  paper. 


Knowledge  is  the  result  of  human  analysis  of  both  data  and  information.  The 
process  of  human  knowledge  acquisition^  (learning)  and  storage  (memory)  are 
not  very  well  understood.  Confronted  with  a  vast  array  of  data,  information, 
and  uncertaint^humans  have  the  ability  to  solve  problems  (and  make 
decisions)  with  varying  degrees  of  success. 

At  present,  computer  information  systems  facilitate  making  data  and 
information  more  readily  available  to  human  beings,  but  human  knowledge  is 
required  for  practically  all  complex  problem  solwtit^and  decision  making. 
Expert  systems  are  attempting  to  put  human  knowledge  in  electronic  form 
(knowledge  bases),  and  the  process  of  doing  this  preferred  to  gs  knowledge 
engineering.       k>-o   L\  ✓^-t^*_r>-j^'*AwCrc4i^cL^ 


Conceptually,  data,  information^and  knowledge  would  converge  into 
intelligent  electronic  systems,  but  progress  has  been  excrutiatingly  slow. 
Despite  considerable  publicity,  there  are  significant  barriers  to  the 
development  of  intelligent  machines  for  practical  problem  solving. 


C.       PONT  UNDERRATE  PROBLEMS 


The  primary  reason  4=G^l_ovelace^cycle  exists  is  because  the  computer 
industry  has  traditionally  underrated  implementation  problems.  As  artificial 
intelligence  and  expert  systems  emerge  from  the  academic  environment, 
there  are  indications  that  implementation  problems  will  be  especially  severe. 

There  is  fundamental  ignorance  concerning  how  humans  learn,  how  knowledge 
is  stored,  anal,lfrn^iCj^intuition  -playg-m^complex  problem  J&Jtrrr&^  These 
difficult  problems  are  being  disregarded  by  many  Al  practitioners. 


The  Al  community  has  isolated  itself  from  many  practical  solutions  developed 
in  operations  research  and  from  much  of  the  knowledge  w^wd^Tias  been  gained 
from  implementation  of  data  base  and  information  systems. 


A  new  profession  of  knowledge  engineering  is  being  createdAwithout  the 
benefit  of  the  experience  gained  from  complex  systems  analysis. 

Current  expert  systems  lackj  flexibility  and  adaptability,  ana^are  inclined  to 
fail  as  they  approach  the  periphery  of  these  narrow  domains  (areas  of 
expertise).  They  do  not  know  the  limits  of  their  knowledge/and  cannot  adjust 
to  the  knowledge  level  of  the  human  expert. 

fat  e*\ 

Current  experience  indicates^xcessive  maintenance  is  required  tonsure 
acceptable  performance  and  systems  quality. 
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D.       DONT  UNDERVALUE/CONCEPTS 


As  information  systems  become  more  complect  becomes  essential  to 
formalize  how  data  and  information  are  being  used— in  other  words^how  they 
are  expected  to  contribute  to  human  knowledge. 

End-user  access  to  large  central  data  bases  makes  them  subject  to 
misinterpretation  and  to  the  generation  of  conflicting  information. 

As  more  information  becomes  available^there  is  a  tendency  for  quality 
(or  ability  to  assimilate)  to  diminish,  and  the  acquisition  of  knowledge 
becomes  more  complex. 

Individuals  using  available  data  and  information  are  using  personal      .  . 
computers  and  human  knowledge  to  generate  more  information^  It  ' 
becomes  essential  to  understand  the  "human  element"  applied  to  this 
new  information. 

It  becomes  essential  to  apply  advanced  toojs  from  operatior^research, 
statistics,  and  Al  if  decision  support  systerr^are  to  be  effective  in  such  a 
complex  environment.  In  other  words,  there  is  tremendous  uncertainty  in  the 
emerging  environment. 

Intelligent  systems  are  required—especially  in  the  sense  of  being  able  to 
explain  how  and  why  they  reached  the  conclusion  (or  generated  the 
information)  they  did. 

As  systems  become  more  complexJt  becomes  increasingly  difficult  to  make 
them  "user  friendl)*".  Intelligent  systems  are  required  to  guide  and  educate 4her^ 
users.  r 
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or 

E.       A  POSITIVE  COURSE  TCTACTION 


'^STab+tst/an  advanced  technology  research  function»under  the  IS  department. 
Al  research  has  had.narrow  focus  in  its  application  to  business  problems. 

it 

Knowledge^base^development  is  where  data  base  development  was  twenty 
years  ago,  and  it  is  more  complex.  Basic  knowledge  concerning  OR,  statistics, 
information  theory,  decision  theory,  and  library  science  will  be  required  in 
addition  to  Al. 

There  are  few  practical  applications  of  expert  systems  at  4^e^resent4fme2->' 
and^narrowness  of^domains  dictates  that  great  care  be  exercised  in  exploring 
the  potential  of  expert  systems.  This  selection  problem  is  compounded  by 
extremely  broad  array  of  "potential  applications"-wWrtfTw^currently  being 
publicized.  A  non-critical  problem  would  probably  be  best. 

Tools  such  as  *^JSP  machines^^are  currently  dictating  the  problems  being 
addressed  by  Al.  LISP  is  an  old  language-wfetch has  never  been  formalized 
(there  JSf*^  practically  an  infinite  variety  of  Al  languages).  General  claims  of 
systems  development  productivity  should  be  viewed  with  a  high  degree  of 
skepticism. 

^Concentrate  on  qualit)^  Do  not  apply  Mjto  be~on  the  "leading  edge|^| 
especially  when  better  solutions  are  available.  Expert  systems  are  goin^to  be 
costly  in  terms  of  both  machine  and  human  resources.  In  addition,  they  may 
not  work,  and  you  may  not  know  it. 
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Ill       WHAT  IS  ARTIFICIAL  INTELLIGENCE  ? 

0 


A.       A  BRIEF  HISTORY 


In  interpreting  the  work  of  Charles  Babbage  on  the  Analytical  (Engine  {Ada 
Augusta,  Countess  of  Lovelace,  stated: 


«?^xaggerate^jdeas 


•"It  is  desTratrw  to  ^wnrhuybiirsl  -tfaeptJSAibility-,. 
that  ftttght  arioo  aojtCT|the  process  of  the  ^(nalyticaliEngine.  Jo-*-' 

■w^uljjeej J  there  is  frcqoenfrty^a  tendency^jfo^Pto  i/v+^V 
■find  to  bo  enready  in+eroot!ng-or  ramarltablot-qftd^i^^1' 


considering  any  new( 


overrate  *hafw6 


^wmndly,jviin  snrt  el  nytvral  n?a^tion 
■the^^se^trtcn  wo  do  discover  that 


undervalue  the  true  s+ateof 


4hefr-wefe-peally  tenable^ 


our  notions  have  Gurpassed  thoso^ 


The  Analytical  Fnginr  hni  ho  prrtpntivnB  yhetaweMo  originate 
anything,  -JVcan  ^>  whatever  wc  know  how  to  order  tt  tu  pei  lui  iiu  It 

can  follow  analysis)  but  Jt  has  no  pow^r  of  anticipating. any  analytical 

fkc  pi/rpo^<-ArJ  CAp^c'Jy  of-  /Ac  d(<"~cir-fc  ft>  ftidkC' 
Its  province  i6  to  acoiot  uo  in  making  available  what 

y^e€ftw" 


if-. 


we  are 


rreadyrfioquaintod  wi 


Lsage  observations  are  as  appropriate  today  as  they  were  over  100  years 


ago.  The  tendency  to  "overrate"  and  then  "undervalue^can  clearly  be  seen 


whether  we  consider  the  "electronic  brains"  of  the  I950s,»higher  level 
languages  in  the  1960s,  data  base  management  systems  in  the  1970s,  or 
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decision  support  systems  in  the  1980s.  Al  and  expert  systems  will  be  subject 
to  the  same  tendency,  and  if  Lad^J_ovelgc^!s_  advice  can  help  us  moderate  this 
tendency,  she  deserves  more  recognitionJthar^havTng^programming  language 
named  after  her. 


However,  the  fascination  with  a  "thinking  machine"  simply  will  not  go  away 

despite  the  clearly  stated  lack  of  "pretensions"  on  behalf  of  the  Analytical 
Zp  **  ■-' — — — — — >*  H««*;»tWe. 

^Engine.  Alan  Turingkwent  to  some  length  to  present  eontrarttviews  injiis 

exploration  of  whether  machines  coujoMhJnj||^omputina  machln^^and^^ 

artificial  ^ntelligenceff/^ATter  devising  the""1  urlhgfest"  to  resolve  that 


JestT 


J*. 


ion 'and, concluding  that  a  machine  could  be  constructed  which  could,  pass 
that  test,  he  specifically  addressed  L^d^-ovelcice's  analysis  of  the Analytical 
.Engine^  capability— specifically^he  implication  that  a  machine  can^iover  do' 
anything«*«of^nev5^^uring\respon^('to  LaayA-ovelace's  "object  ion^J^s^s-^*^ 


^The  view  that  machines  ccinnot.  gfve  rise  to  surprises  i 


is-dueyT-bc  I  i  e  vc  — - 
*  d.»  t^y         ten),  trc  $v*$<4rc<£  fKAT  flutters.  otfc*\  efrtyytco^lytiss/^r/titc^ 
to  a  fallacy  to  which  philosophers  and  mathematicians  areparticijlarlv  <* 

ubjoctt  This-is-ihe  assumption  that  as  s< 


Vi  miftJ 


soon  as  a  fact  is  presented  to  a  <- 
Itanoously  with — e_ 


s  a  tac 

id  all  consequences  of  that  fact  spring  into  mind  aimu 

S*>6fC<.7h    -h,  bcT  P^f"  /*,  Atiftr-fJirfesCj   T*  I  /<tr«Vvts .  >  fX(^ 

it.  It  ut  a  very  useful  assumption  under  many  Gir-cumstgnces,  nut 
tnh  wnrilv  fnrgntn  thnt  it-is  false/  A-nixtLiJ^34-<wt<^qfmnce  ©f  do4F» 


-OA©— 


■that  one  therrassumes  -thajfthere  is  no  virtue  in  the  mero  working  out<_ 
of  consequences^f rom  data  and  general  principles^**6— 


It  should  be  pointed  out  that  Turing  did  not  see  fit  to  even  discuss  the 
question  of  "can  machines  think?"  because  he  considered  it 
meaningless,  he  conjectured  that  by  the  end  of  this  century  one  would 
be  able  to  speak  of  machines  thinking  without  expecting  to  be 


contradicted.  He  then  stated  that^Conjccturcs 


mg  without  expecting  to  be       .  a  rt*eA'tL 

"Conjectures  ere  of  great-^. 


VW**^  ^1  mporton^Btfeinoe  they  augges*  useful  lines  of  r«60QrehiH€-  ■ 


TO. 
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Some  of  the  most  creative  minds  of  this  century  have  been  engaged 
inj^uch  research  •fa^ia^speculation^^lnce  Turing  established  his  tes^and 
the  case  is  still  being  argued. 


INPUT  has  reviewed  many  of  the  arguments  pro  and  con  on  the  subject  and 
iwsyrhe  following  observations^  n lukec OS 

At  the  time.Turing  made  his  conjecture  .the  art  of  computer 
programming  was  not  very  well  understood.  It  was  assumed  that 
computers  would  "do  what  you  told  them  to  do"  even  if  what  you  told 
them  to  do  was  "something  new|^ 

There  is  no  question  now  that  machines  canVugtve~  rise  to  surprise^"*-*-'' 
Unfortunately,  most  of  these  surprises  have  been  of  the  information 
variety—?they  are  called  bugs^pnd  they  admittedly  are  present  in 
programs  of  even  moderate  complexity. 

It  is  ^unintuitive  judgment  that  information  surprises  will  be  a  major 
factor  in  the  acceptance  of  all  machines  and  systems  exhibiting 
artificial  intelligence,  and  especially  if  such  machines  are  deemed  to 
be  thinking.  It  is  likely  that  humans  will  be  less  tolerant  of  errors  on 
the  part  of  machines  than  they  would  on  the  part  of  other  humans— if 
for  no  other  reason  than  the  fact  that  humans  are  better  able  to  cover 
their  mistakes. 

During  the  giant  electronic  *1brain"j>eriod  ofj^)950s  there  was  considerable 
speculation  about  whether  computers  could  think,  and  the  public  and  most 
"experts"  concluded  that  -fcqdyi-ove lace  wtra-  right  -{vbmputers  iwkvanly-de-*-'' 
what  you  tok^them  to  do.uftThinking^rnachine  research  disappeared  into  the 
universities  under  the  name  of  "complex  information  processing"  and  "machine- 
aided  cognitionfj(|  Then  John  McCarthy  coined  the  term  "artificial 
intelligence"  in  the  1960s,  and  it  stuck.  However,  even  today  there  are  those 
who  feel  the  term  is -nonappropriate  and  might  stir  up  the  oldpControversy 
%e£ji  e  I  lie  pubtiyigain.  It  probably  will— if  it  already  hasn't. 


-  3  -  (U-SAI-MI)  PH  3/7/85 


B. 


ARTIFICIAL  INTELLIGENCE  DEFINED 


The  best  way  to  define  Al  is  through  the  research  areas  ^wWen! have  received 
emphasis  over  the'jlast  twenty  years.  However, -tt^has  it£  roots  in  the  desire 
of  behavioral  psychologists  to  model  human  cognitive  behavioi^which 
involves^  hypothesizing,  reasoning,  perceiving,  associating,  speculating, 

s 

learning,  guessing,  and  drawing  conclusions.  These  are  complex  processe^ 
Amiehvary  significantly  from  individual  to  individual,  tatrhe  degree  that 
measurements  can  be  mader-end/implementation  in  therhardwareykoftware^of 
the  human  brain  remains^so^mething^of  a  myster^berlo^  the  left  brain^right 
brain  generalizatior^andjjser^ry  locations.  (In  other  words,  we  don't  have  a 
very  good  storage  map^much  less  ef?an  understanding  of  how  the  program 
works.) 


Al  has  fundamentally  been  an  effort  by-mafhto  create  machines  in-htapwn 
imag^at  least  in  go  far  graving  them  exhibit  human  cognitive  behavior. 
Some  of  the  major  subffrelds  of  Al  in  which  modeling  has  been  done  are: 


1° 


Natural  language  interpretat?on»--whye^intelligence  is  combined  wit 
visual  imaging  and  pattern/object  recognition  to  permit  computer 
analysis  ^f,  and  response  to,  the  external  world. 

Speech  inj£r^retgtiont;>-whep»,intel ligence  is  combined  with  aural 
processing  and  recognition  to  permit  verbal  H=nef^machine 


communication^. 


3oiMrtiGi^ewhe«_intelligence  is  combined  with  mechanical  servo- 
mechanisms  to  produce  "by&%£son"  rather  than  "by-r^te"  machine 
physical  processing.  * 


-  k  -  (U-SAI-III)  PH  3/7/85 


J^aoiAdedge^ased^expert  systems^  wherftjntelligence  is  applied  to 
computer  solution^ 
reasoning  to  solve. 


res 


computer  solutionjof  problems  whose  complexity  or  inexactnessmnd 


Y 

When  reviewed  against  the  interests  of  behavioria.1  psychologists  in  human 
cognitive  behavior  (hypothesizing,  reasoning,  learning,  etc.),  it  becomes 
apparent  that  the  intelligence  applied  in  most  of  th^research  areas  has  yet  to 

address  the  primary  issues^except  to  expose  the  complexity  of  the  human 

.  •  V 
cognitive  processes. 

Indeed,  at  the  1984  American  Association  of  Artificial  Intelligence-^ 

convention  in  Austin,  Texas;  Marvin  Minsky  (one  of  the  many  "fathers 

of  Al)  specifically  pointed  out  some  of  the  deficiencies  of  Al 

research:  "Al  has  been  shockingly  deficient  in  developing  theories  of 

machine  learning.  (For  example)  only  a  little  Al  research  has  gone  into 

the  study  of  machines  that  leap  by  analogy ^People  avoid  hard  and     •  •  -  » 

important  problems  just  as  long  as  they  possibly  can." 


Concern  about  A I  research  has  also  been  expressed  by  IBMyice 
Resident  and  J^hief  ^ientist  Lewis  M.  Braj^scomt^vl  iu  dw^lukid^J^'*"^""'' 

,KC|TeextravagCmt  statements  (aBbuj^AI)  of  the^pqst feW'y^ars 
have  DBQome  a  sourbe^of  concern  to  many^of  us  wha-have  been 

excessive  cTakns  by  researchers  in  other  fiejdsvleaid  to   „ 

unreasonable  expectations  by  the~pt»felic."  /(Shades  of  Lady  Lgt*-^CC*. y~ 


v  Lovelace.} 


2- 


Expressing  his  concern  about^limited  progress  of  Al  research  in  a 
number  of  areas,  Branscomb  pointed  out  that  only  70  papers  had 
been  presented  at  the  1984  AAAI  conferencej*hef< 

of  that  size.wxkuldrhove-ho* 


materials  science  conference 
1*0  P>   ,  ,.n09< 


700  e 


Ynbab^i  .Qcrhaps-cvcBj ^00/papersj{*tSpi<tl fait*  b*(/\  pre }CAt(J  *K  txf 


V 
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However,  the  major  sub-Melds  of  Al  research  do  have  potential  for  substantial 
benefit  and  should  not  be  "undervalued"  even  if  the  tendency  to^overrate"^' 
them  is  already  apparent  (at  least  to  Mr.  Branscomb).  INPUT'S  observations 
concerning  the  selected  subj-fields  is  as  follows: 

Natural  language  interpretation  of  high  quality  is  essential  if  the 
Turing  Twr^js  to  be  •H^fr'lThe  Turing  test  essentially  states  that  if  a 
human  sitting  at  a  terminal  having  a  dialog  cannot  determine  ^cthcr  4 
he/she  is  conversing  with  another  human  or/a  machine^ythen  the 
machine  can  be  credif^ed^ith  intelligence  machine  cannot  be 

considered  intelligentjjwrrnflj'quasi-intelligent"  conversation  remains 
the  current  goal  of  natural  language  interpretation,  natural  language 


systems  do  not  as  yet  have  the  ability  to  pass  the  tesLand  there  is 
considerably  speculation^  about  whether  they  evejrywill,  and  what  it 
would  really  prove  anyhowjTests  other  than  Turing's  "imitation  game" 
have  been  suggested^-jtests  AMh+eJ^get- a^tne-a inner ly-wg  understanding  g-r 
having  the  machine  explain  why  it  is  doing  what  rt-te*-^ 
doing/or  respondifl€hthe  way  it 


The  fact  remains  thcJconversations  between  humans  and  machines  are 


at  best  strained  and.generally-mere^unnatural  thun  nuluial^Gucih  q^lXc- 
respected  computer  scientist  •ea' Dr.  Edgar  W.  Dijkstra  considers 


te^fv^tC  anthropomorphism  (as  represented  by  the  desire  to  converse  with 
computers  in  natural  language)  to  be  unfortunatef*^ 


"And  now  we  have  the  fad  of  making  all  sorts  of  systems  and 
their  components  "intelligent"  and  "smart".  It  often  boils  down 
to  designing  a  woolly  man-machine  interface  that  makes  the 
machines  as  unlike  a  computer  as  possible:  the  computer's 
greatest  strength— the  efficient  embodiment  of  a  formal 
system— has  to  be  disguised  at  great  cost.~~So  much  for 
antoropomorphism."  "* — 

*c^W$   *s  tyjkitr*  re^ktj 


jLis*»s**  I  -  6 -(U-SAl-lll)PH  3/7/85 


It  is  INPUT'S  opinion  that  the  quest  for  natural  language 
communication*  between  i^naf^machine^irnot  only^costly  but 
Og        would  prove  unsatisfactory  for  both  theffi  »and  the  mach 


ine. 


However,  the  author  remembers  the  first  time  Autocoder  on  the  IBM 
705  typ^ed  out  the  following  message  on  the  console  typewriter:  "NO 
TAG  ERRER,  ASSUME  TAG  ERROR"  in  the  middle  of  a  twenty^ninute 
asjembly  and  continued  running.  The  machine  had  "guessed"  right  and4+*^> 
wootcrsave^a  big  chunk  of  machine  time.JIt  makes  no  difference^fjL**^ 
whether  dictionaries,  punctuation  programs^and  passing  algorithms  are 
really  Al.  Even  limited  intelligence  and  understanding  of  natural 
language  is  valuableand  research  should  continue. 

It  certainly  will  be  possible  for  machines  to  "readj^jclassif^cross- 
reference,  and  file  documents  with  increased  sophisticatior^and  this  is 
going  to  be  necessary  as  we  proceed  toward  electronic  offices. 

Image  signal  interpretation  can  be  viewed  as  still  being  in  it's  infancy 

when  it  comes  to  playing  with  various  shapes  and  colors  of  blocks,  but 

substantial  practical  applications  are  already  possible  based  on  pattern 

recognition  research.  It  is  possible  to  recognize  handwritten  symbols 

sufficient  to  incorporate  automatic  reading  and  encoding  of  data  from 

documents.  Realizing  that  some  hand-written  information  has 

fi-  A 

traditionally  be  unreadj£>le  by  human  beings/ll$il3©H:ne4i€af-prof«5si^ — 
-betng-o-glaring  experienced  it  is  not  beyond  the  realm  of  possibility 
that  humans  may  eventualfybe  required  either  to  write  so  it  is^reaojjble 
-byrrrachin^" or^earn  to  use  a  keyboard.  It  is  not  important  that 
machines  "^2"  and  even  remember  like  human  beings.  In  some  cases, 
they  probably  will  be  better,  and  in  others  they  will  never  be  as  good. 
Once  again,  continued  and  extended  research  is  highly  desirable,  but 
the  anthropomorphism  deplored  by  Dijkstra  remains  a  problem. 
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Speech  interpretation  sufficient  for  many  practical  applications  is 
already  possible^and  full  transcription  of  voice  documents  is  certainly 
attractive.  All  of  the  comments  concerning  natural  language  and 
image  signal  interpretation  apply  here,  but  a  few  additional 
observations  are  required. 


It  maybe  both  practical  and  useful  to  use  "voice  prints"  *e-heive^ 

indm^tte^withdravv  money  frorrtbank^or  unlock'^CT^- 

 ^<7-  ^^IkU'yrt^H  s 

automobileJJbut  4het^are  a  lot  ofAapplications  v^ioh^woujH]  ^ 


seem  to  have  limited  practical  value. 


an 


.For  example,  except  in  situations  where^hands.  are  -Ret"  avail  able 

.         or  „  .  .      ,  gr'iA.Sgy^X^sei.  aJ  A. 

"tdtmng-a-eeis  flying  an  airpldrfe^physically  handicapped,  etc,) 

there  is  4fm4+«d  need  to  ia4k~+^  machmeft-whefe^ punching  a  few 

buttons  would  suffice— for  example,  in  fdialing^a  telephone  or 

even  "looking  up*'  a  number.  C  .  x  .  /T\ 

^>Fe4mpoF4:q»tly4tnie|'e  whole  class  of  people  -whe- 

clai  m  thcy^arc^  waiting  to  talk  to  computers  before  they  will  use 
them-jit  is  INPUT'S  opinion  that  the^e  are  precisely  the  people 
who  will  never  know  what  to  say  to  their  computers  anyway. 


Robotics  in  its  ultimate  form  would  integrate  all  of  the  other  sensory 
and  cognitive  research  into  a  neat  package  wJ^Se)^  would  emulate  a 
human  being  or  perhaps  improve  on  the  model.Jlt  should  be  pointed  out 
here  that  a  great  many  of  the  concepts  of  robotics  (of  all  varieties^ 
from  automated  machine  tools  to  the  more  advanced  versions)  came 
from  Norbert  Wiener^who  can  be  called  the  father  of  cybernetics/ 
^vhich  existed  prior  to  A^He  drewthe  parallel  between  biological  and 
electrical  systems  in  terms  of  feed-back  loops^which  are  so  essential  to 
any  complex  system.  (Wiener  remained  cautions  about  the  jpteMrtV 
K^man-machine  relationship  until  his  deathj^especially  in  supporting 
decision  making,  as  proposed  by  his  friend  fqf>d-Gontcmporar>sJohn 

7 


von 
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Neumannr-more.  on 


1> 


Robotics  have^a  broad  range  of 
applications  ranging  from  practical  factory  automation  systenvto  the 
whimsical  personal  servant^jody-enjto  computers  wWc^build  new  (and 
perhaps  better)  computers.'  Just  a  few-interesting  examples  and 
ipwuululiun^:" 


A  rol 

battery  runs 
and  plugs  itself  in— it 
telephone  into  it 
you 


developed  which  wanders  arounji-until  it's 

up  to  a  power  outlet 
be  any  tricks  to  build  a  mobile 
name  (Watson)  when 

(but  do  you  really  want 


which  point 


able  to  cc 


A  rob^t  recently  made  the  local  newspapersJ§a«-Francisco)  by 
wander  ing^rmujdjn a  restaurant,  taJkMcfwith  customers,  and 
passing  out  passes  to  amoVrj><Ia[the  process  managed  to  disrupt 
the  restaurant  (byrj^wltng  into  thingsTwhTthHar^bably  did  not 
permit ^soiietfTng  any  how  (this  is  not  considered  a  pracTTT 
applications). 

A  "prac+ical  robot"  incorporating  most  of  thejadvanced  Al 
research  preserved  thus  far  would  re^jd^ffiof  the  paper 
documents  (includin^^cqputej^-pl^uced)  coming  into  the 
office,  tell  you  what^Hvas  doTh*gsAtith  those  it  was  retaining  and 
ask  if  it  wasJDKoefore  shredding  the  worfhtes§j)nes  (including 
bulk  mail$— but  there  must  be  a  better  way. 


The  point  is  thal^nthropomorphic  robots  have  highly 
questionable  payback  (c^desjjatsTnty)  and  may  be  diverting  Al 
research  effortejj^rrTrnore  pra^tTcTrHaur^yits. 

^Xnowledge^based^xpert  systems^is  where  the  real  activity  is  these 
days^and  the  next  section  will  explore  this  Al  subjfield  in  detail. 
However,  there  are  two  important  general  considerations  in  such 
systems: 


-  9  -  (U-SA1-IN)  PH  3/7/85 


It  is  easier  to  "hide  the  human  being  in  the  mechanism"  in  such 
systems  and  pretend  the^reTe^biting  intelligence,  and  you 
can  be  sure  this  will  be  done. 


It  is  more  difficulty  detect  "unpleasant  surprises"  in  an  expert 
system  than  it  isf-^irusay,  a  robot .  beng^  aTOund-in-q-restaurant-g^ 
B^pndjit  is  also  easier  to  hide  mistake^  (either  intentionally  or 
unintentionally). 

The  combination  of  these  two  factors  has  high  potentiator  both-** 
hardware/software/knowledge  problems  with  the  artificial 
system^and  for  human  skulduggery^this  is  a  bad  combination. 

Before  proceeding  with  a  more  detailed  analysis  of  expert  systems,  it  is 
necessary  to/review)  briefly/some  parallel  developments  J^hichjwi  1 1  have-cposs-* — 
impact  on  each  other. 

/>.£.,  o.t.j***C.C 


There  is  a  common  heritage  of  artificial  intelligence  (A  I),  opevratjng^research 
(OR),  and  command  and  control  (CC)  system^et^^trie  UniteaMKingdom 
during  World  War  II,  and  many  prominent  persons  crossed  pathos  working  on 
different  parts  of  the  "messy  problems"  associated  with  the  more  mobile 
warfare  AA&ieWjwas  developing  on  Ji^and,  sea^n^in  the  air. 


it**" 

Turing  was  working  on  #wrmachines -w+neh^ would  be  used  to  break  the 
German^  Enigma  codes. 

Wiener  was  working  on  problems  associated  with  controlling 
antiaircraft  fire  by  feed-back  loops  for  position  prediction. 
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Breaking  the  codes  required  new  techniques  for  intercept ^of^both 
aircraft  and  U-bo^ts  if  the  real  pay-off  was  to  be  achieved.and  the 
term  "operations  research"  was  born.  J 

John  von  Newmann  was  everywhere,  meeting  with  both  Turinq  and  14. 
....      (9  Wc.^         .    _  ,    fr?  , 

Wienei^-aoi^concerned  with-botfl  the  development  of  computers  andykthe 
atomic  bomb.  Von  Neumann  was  already  the  leading  expert  on  game 
theor^which  would  become  increasingly  important  in  .command  and^ 
<cen+r<^  systems. 

OR  became  popular  after  World  War  ll^and  its  techniques  were  extended  to  a 
number  of  pragmatic  problems  in  industrial  engineerinqA«ncfto  various 
operational  problems  inyfrransporTafion^communications,  and^other  complex 
scheduling  problems.  There  has  been  relatively  little  contact  between  OR  and 
the  more  advanced  aspects  of  Al,  but  now  there  is  a  call  from  both  sides  for 
improved  communications  between  therrwthere  ]s  nttle  question  that  there  is 
significant  convergence  between  the  two  general  disciplines.  However,  many 
areas  of  Al  research  are  proceeding  without  the  benefit  of  OR  experience,  and 
most  OR  professionals  are  not  acquainted  with  Al  progress. 

John  von  Neumann  left  his  mark  on  the  nuclear  strategy  of  the  United 
States.  War  gaming  and  strategic  planning  have  been  based  on  game  theory 
concepts^and^lCBM'sleave  no  time  for  parlj^nentary  debate  (or  everyyery 
many  telephone  calls)^pomputerized  decision  support  systems  are  inherent  in 
nuclear  deterrence.  From  ther^AI  has  filtered  down  to !^>mend-tifld-GontFof-^- 
systems  at  the  battlefield  level. 

It  is  clear  that  the  mat  complex  (to-say-no I hifiu -o^,  cruc ia I)  expert  system|M^i^ 

by  DOD.  Except  forAa  tew  wild  rumc 


have  been  developed  by  DOD.  Except  for^a  few  wild  rumors  concerning 
malfunction  and  the  impact  of  high^tress  war  gaming  on  the  human  experts 
playing  the  games,  the  general  public  and  business  community  are  unaware  of 
how  well  such  systems  work.  Indeed, 4t  to  probable  thuK  a  good  argument  can 
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be  made  that  such  systems  will  be  full  of  "surprises"  if  they  are  even  put  into 
ope^ition.  However,  one  thing  is  certairW^there  comes  a  point  when  a  human 
must  trust  the  system  enough  to  take  action  or  the  system  becomes  an 
impediment  to  decision  making.  It  is  probable  that  expert  systems  will 
demonstrate  many  of  the  attributes  of  CC  systemSjthat  is  where  decision 
theory,  computer  analysis^and  Al  have  been  applied. 

In  commenting  on^attendance  at  the  1984  AAAI  conference,  an  observer 

estimated  that  approximately  one-+ialf  of  the  attendees  were  from  colleges 

0£  .  .  _a       ,    W^*^  of       U2C  mo  or 

en^universities^one-fhird^from  government^  industry^ellers^a«^_users  of  Al 

(with  the  largest  group  of  these  from  DODj&ind  the  remainder^Trom  research 

institutes.  He  then  went  on  to  say:  "Still  largely  absent,  however,  are 

representatives  of  the  professional,  industrial^and  financial  communities 

toward  whom  much  of  this  activity  is  targeted." 
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IV  KNOWLEDGE^BASE^EXPERT^SYSTEMS 


A.       STATUS  AND  TERMINOLOGY 


There  are  two  major  categories  of  vendors  associated  with  expert  system^T) 
those  who  apply  AI  techniques  to  the  development  of  specific  application 
systems,  and  those  who  provide  the  hardwarejisoftware  tools  to  assist  in  the 
development  of  such  systems.  Since  the  hardwareisoftware  tools  support 
research  activities  and  apply  to  all  of  the  AI  sub^jfields  (and  have  been  around 

tantially  more  revenue.  The  companies  wfiich  claim 


longer),  they  have  substanti 


expertise  in  the  development  of    now  ledge-based^  or  expert^systems  have 
normally  been  spawned  out  of  the  universities  witn  many  of  tne  principals 
continuing  to  hold  faculty  positions. 

The  sudden  rush  of  activity  directed  toward 1  application-©!  A 1  to  business 
problems  seems  to  have  been  spawned  by  a  number  of  factors  including!  the 
Japanese  Fifth  Generation  computer  efforftentrepreneurial  spiritjlthe 
reported  success  of  a  fewresearch  projects/jjand  a  rush  to  preempt  names  such 
as  Cognitive  System  Inc.jTeknowledge,  Inc.fand  Intel liCorp. 

The  "threat"  of  the  Japanese  Fifth  Generation^provided  a  focal  point  of 
commercial  attention  for  Al,^much  of  the  current  activity  can  be 
classified  as  the  response  of  the  free  enterprise  system. 


However,  the  sudden  activity  in  AI  has  also  been  inspired  by  the 

successful  commercialization  of  genetic  engineering^rcl^rne  winter 

r  ~. 
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1985  issue  of  .^JLMagazine  contains  an  article  "Comparing  Artificial 
Intelligence  and  Genetic  Engineering:  Commercialization  Lessons." 

ft  ivories  v*VjAY"  _ 

The  abstract  ^tatcs^n  parts  "Artificial  iillt^liyeiice-js-rapkUy  Jeav4ft€H2- 
i^academic  +»ome  aftd-f»ovtng-i,nto  the  markctplae* 
43i^edent^w-«tr-arccme"TicaTteTr^ 

so  rapidiy»~Bt»t^)genetic  engineering,  wfwcfe  SaaaiJfrfafeww*  f «rth  fr»m  -° 
•acqdemi&  to  bcoemo  tho^foundation  for  theJ^^new.  biotechnology  y 

awaiting  the  g_ 


If  **** 


dx*. t  ^-tktr^'iCj  "few 

Then,  of  course,  the  media  (and  market  research  firms)  are  also 
involved  in  stirring  up  the  pot. 

The  press  was  out  in  force  at  the  1984  AAAI  conference^nd-^  ' 
John  McCarthy^tnjLhis  President's  Addres^py^an  equation  on  the 
screen^'so  that  the  representatives  of  the  press  won't  think  that 
they're  understood  everything 4ka^they've  heardj^here."^""I£<:7'*  Se**^5- 


0f\ 


This  prompted  some  later  discussions  -te^how  press  relations 
could  be  improved. 


But,  not  to  worry,  the  market  for  LISP  machines  alone  was. 
forecast  to  be  $1  billion  by  1 990? arjdpwrvr  venture  capital  firm 


could  resist  the  new  terminology/     "T^c*-  jJ^scs     in  tjiifr  |-rr*y^ — 

The  computer  industry  is  not  unacquainted  with  the  use  of  new  terminology, 
but  Al  and  expert  systems  have  arrived  on  the  scene  with  a  wh|le  new  set.  In 
order  to  understand  expert  systems,  it  is  necessary  to  define  some 
fundamental  terms  and  concepts: 


it*.* 


Symbolic  representatives  are  the  substituting  of  real-world  objectives, 
concepts,  and  relationships  by  abstract  symbols  (letters,  numbers^or 
special  characters)  wo+e^can  be  manipulated  logically  by  programmed 
computer  processes. 
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Symbolic  inference  is  the  derivation  of  new  facts  or  previously 
undeclared  knowledge  from  existing  information  through  the 
application  of  formal  and  informal  logic  and  search  techniques. 


Heuristic  search  implies  the  use  of  rules  of  thumb  for  learned  and/or 
experiential ly  derived  human  expert  methods  used  to  narrow  a  search 
and  guide  it  toward  resolutions. 

Confidence  factor  is  a  numeric  value  associated  with  a  fact  or 
heuristic  to  indicate  an  individual  or  combination  weighting  of 
reasonableness  or  predictability. 


Fuzzy  set  is  a  logic  formalism  expressing  the  relative  set  membership 
of  an  item  in  which  inclusionfexclusion  is  not  absolute  but  is 
represented  on  a  continuum  of  values. 

Inductive  discovery  is  reasoning  from  individual  observations  toward  a 
general  principle. 


Deductive  reasoning  is  reasoning  from  a  general  principle  toward 
individual  observations. 

Public  knowledge  is  that  which  is  generally  available  through  text 
books,  encyclopedia,  seminars  (proceedings),  etc. 

/ 

Private  knowledge  is  that  which  is  individually  developed;  usually 
through  learning,  experience^experimentation,  etc.  (And/fhrough 
what  you  have  probably  called  systems  analysis^nd-k^now  being 
referred  to  as^knowledge  engineering^^) 

•BadJduring  the  days  when  the  mystery  of  the  new  "electronic  brains"  was 
being  dispelled,  the  president  of  a  major  transportation  company  concluded 
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ram 


that  computers  were  really  no  mystery  at  al|^Jgs  he  so  aptly  put  it^"All  a 
computer  can  do  is  say:  ^is,Yair##is/tain^y  The  simplest  explanation  of 


an  expert  system  is  that  it  can  say  "maybe"  and  ^proceedffrom  there.  In  other  ,   ,  i. 

ft)    Am     A  *  *l«s— HdiAT 

jwy^not  ■  "tfo-taiof "  mac  nine  bur  a 


words,  the  human  brain  is  not  binar 


Ujf& "maybe— I  wonder"  process.  The  expert  system  attempts  to  emulate  human 
decision  making  and  give  expert  "consultation  and  advice"  in  a  well-defined 
and  narrow  domain  of  expertise. 

Y 

Expert  systems  have  two  major  components^  the  knowledge  base  and  the 
inference  engine,  but  can  be  supported  by  other  sub^fields  of  A^such  as 
natural  language  interpretation,  image  signal  interpretation,  speech 
interpretatioryetc,  as  shown  in  Exhibit  IV- 1, 


IVl 


The  knowledge  base  is  normally  described  as •feei«qj-e=/loose  and  *«uultVj> 

**-   r"l  i  «  i  '""^e/"  . 
unstructured  collee^io^of  facts,  assertions,  inferences,  observations, 

hypotheses,  rules,  and  procedures  specifically  related  to  a  particular 

domain  of  activity^such  as  medical  diagnosis).  However,  it  soon 

becomes  necessary  to  confront  the  fact  that  some  structure  is  requirea^ 

and  this  has  resulted  in  the  following: 


There  is  a  recognized  need  for  expert  systems  to  have  data  base 
access. 


Both  expert  systems  and  data  base  management  systems  are 

recognized  (by  at  least  some  of  those  involved  in  Al)  to  rely  on 
»C 

data/^knowledge  representation  models^and  they  both  involve 
some  inference  making.  f 

However,  they  have  evolved  separately  and  have  placed 
emphasis  upon  different  aspects  of  the  decision-making  process^ 
w4+tvthe  resulythat  it  is  difficult  to  integrate  existing  expert 
systems  (of  which  there  are  precious  few)  with  existing  data 
base  management  systems  (of  which  there  are  many). 
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This  has*and  will^result  in/new  data  base^stems-feetng-^-^" 
-deve+opedj  for  expert  systems. 

The  Japanese  Fifth  Generation  effort  has  opted  for  the 
relational  model  (with  at  least  some  hardware  implementation), 
and  this  seems  to  be  a  wise  choice  (although  performance  of 
even  the  fifth  generation  may  be  strained). 


The  inference  engine  manipulates  and  applies  the  knowledge  bases  in 

progressing  toward  a  problems  solution  (or  decision).  It  extracts, 

matches,  and  applies  (tests)  the  facts,  assertions,  hypotheses,  rules, 

etc.  contained  in  the  knowledge  base.against  the  statement  of  the 

problem,  refining  both  problem  statement  and  solution  as  it  goes 

/v  A. 
along.  Fundamentally,  the  techniques  used  are  those  listed  under  the 

definitions  of  terms  and  concepts. 

The  potential  support  of  expert  systems  through  other  Al  sub^fields  is 
obvious_when  one  considers  the  foquireJHuiman  interface  required  for 


^manjjmachine  interaction,  and  the  desirability  for  computer  assistance 
in  screening  and  structuring  of  public  knowledge  sources  on  specific 
domains.  For  example: 

The  human  expert  should  be  able  to  po^-h+^problem  in  natural 
language  and  enter  ln|[own  knowledge  in  the  simplest  form 


(pictures,  charts,  etc.^ 


i.~k    w^sr   <y 

arvan 


Scanning,  classificatToi^^ata^informatio^reductiQQ^and 
storage^ ofc  printed  material  and  audio-visual  information  to  build 
domain  knowledge  bases  (from  both  public  and  private 
knowledge*  would  do  much  to  facilitate  the  development  of 
expert  systems. 
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During  the  research  for  this  study,  a  popular  business  publication  listed  the 

transportation  company  of  '"fTs^Tairrf"  fame  as  being  a  user  of  expert 

systems.  A  telephone  callito  the^SXicey'resident^iuuullud  in  Hm.Julluwing:  9  ^ 

fAr\admission  thaKdespite  a  lot  of  talk  about  expert  systems  and  Al 
(the  respondent  had  recently  attended  a  meeting  wher»  a  retired  Air 

"j  cr- 

Force  general  had  discussed  the  subject),  he  was  not  really  sure  what 
made  an  expert  system  different. 

When  told.a  publication  had  listed  his  company  as  an  expert  system 
K 

user,  he  stated  that  they  must  have  been  referring  to  a  dispatching 
system^fthey  used,  but  he  commented:  "As  far  as  l  am  concerneaVthat 
system  is  straight  LP  (lim>ted^programming)."  /The  company  hasran  OR 
unit  under  the ^IS  department.)'^' 

-HtSjevaluation  of  the  dispatching  system  was  that  it  did  a  better  job 
than  some  of  the  ne^er  dispatchmajbut  could  not  complete  with  the 
really  experienced  ones.  Ifs^main  value  had  boorudetermined  to  be  in 
traininc^where  it  permitted  dispatchwjjo  be  moved  to  new  territory 
and  become  productive  more  rapidly. 

There  are  clear  differenc&^between  the  LP  dispatching  systerr^and  the 
technical  definition  of  an  expert  system.  However,  some  of  the  research 
projects  on  expert  systems  have(revealed  ^substantially/ the  same  resulf^the 
expert  system  can  produce  results  better  than  X  percent  of  the  human 
experts,  but  in  many  cases  the  Y  percent  of  human  experts  who  are  better 
than  the  system  are  expected  to  handle  the  harder  cases.  (In  other  words,jthe  S 
refecKjVraa  specialist  in  the  medical  profession,  or JwTassignment  o£4he^ 
pifajjexperienced  o^sp^tcher^tc^tig^ifficult  territory.)  In  which  case,  the 

computer-based  system  derives  its  primary  benefit  as  a  training  or  screening 
device. 
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..li 


It  is  obvious  that  the  selection  of  domains  for  the  development  of  expert 
systems  is  very  important^-e«dJaside  from  a  few  widely  publicized  systems/in 
medical  diagnosi  ineral  exploration 

(PROSPECTOR),  there  are  currently  few  new  applications.  -A^an  attendee  at 
the  !  934  A AA1  conference  commented: 


problem  of  Al  seerr^to  be  within  Al;  very  few  applications  of  Al 
tools,  successful  or  not,  are  reported.  I  hear  some  conjecture  that  the 
applications  in  place  are  so  important  that  their  success  is  being  held  in 
strictest  confidence.  More  realistically,  experience  leads  one  to 
expect  that  when  more  has  been  accomplished,  more  will  be  reported." 


B.       HOW  EXPERT  SYSTEMS  ARE  DIFFERENT 


Essentially  if  you  have  a  problem  with  a  specific  solution  and  can  define  an 
algorithm  to  solve  it,  you  do  not  need^an  expert  system.  Expert  systems  are 
for  "fyzzyJ1  complex  problems  w+^&rej  human  judgment  and  reasoning  are 
normally  employed  (with  varying  degrees  of  success).  The  algorithms  nature 
of  OR  problem  solving  would  therefore  rule  out  OR  solutions  as  expert 
systems. 

In  addition,  there «re\g  set  of  general  characteristics -wmefa  distinguish  expert 
systems  from  conventional  data  processing^systeTTC~***ek  may  solve  rather 
complex  problem^'Cree  EaI libit  IV-^ryg^  'ft***-  cUrtcHf^t^  *r<— 

Expert  systems  «xhi1>i4j^  expert  performance  by  solving  problems-wlttcrr"*' 
would  normally  required  a  human  expert.  Unlike  a  traditional  DP 
application^which  is  rigidly  defined  and  leaves  no  room  for  probabilities 
or  uncertainties,  expert  systems  arrive^at  an  acceptable  solution,  in  a 
reasonable  period  of  time,  despite  ill-defined  data  and  processes. 


S 
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Conventional  data  processing  systems  use  arithmetic  symbols  and  ^ 
processes  to  represent  data  elements,  files^and  logic  paths.  Whatevor^ 


mathematical  a!gebra,Jx>olean  algebrc^pr  relational  algebra  is  used, 
they  do  not  cope  very  well  with  abstract  and  vague  concepts  and 
relationships.  Expert  systems,  however,  employ  symbolic  structun^to 
represent  both  concrete  and  vague  abstract  concepts,  hypotheses, 
associations,  -etc^ 

Data  processing  normally  employs  algorithmic  processing«which  means  ^ 

that  the  process  (including  handling  of  errors)  is  predetermined^--*-' 

indeed,  when  surprises  occur-the  program  freguently  aborts.  Expert 

systems  employ  non-Taeterministic  symbolic  inference.which  means.the 

y  A, 

seguencing  of  operations  and  the  logic  applied  is  dynamically 
determined  by  the  system.  Surprises  are  expected  as  a  result  of  partial 
problem  solutions  and  external  events&the  system  adjusts  itself  and 

3  solution.  . 


Conventional  data  processing  systems  normally  employ^single^-patl^pr 
an  exhaustive  search  of  all  possible  candidates  in  seeking  a  problem 
solution.  Expert  systems  use  heuristics  or  "rules  of  thumb"  to  narrow 
the  search  and  guide  it  toward^  a  workable  j£J  mperfect^solution. 
Because  of  heuristic  search ing»expert  systems  can  address  large,  more 
complex,  fuzzy^and  norij-deterministic  problems  WmeHcould  not  be 
practically  addressed  by  the  exhaustive  searches  of  traditional  DP 
approaches. 


Expert  systems  have  extensive  domain  knowledge,  both  public  and 
private  as  their  foundation.  (This  actually  represents  a  shift  fromf 
emphasis  upon  laws  of  reasoning  and  inferenc^which  resulted  in  the 
development  of  earlier  cognitive  systems,  and  is  comparable  to  the 
early  DP  experience  of  developing  general  purpose  management 
information  systems  without  underlying  data.)  DP  systems  usually  only 
concentrate  on  specific  data  required  for  actual  process ing^even  if 
those  data  are  the  result  of  an  extensive  data  requirement^  study. 
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When  heuristics  associated  with  a  domain  fail  to  result  in  a  successful 

search,  expert  systems  normally  fall  back  to  "weak  reasoning^  based  on 

general  logiq\fo  provide  some  answer.  Conventional  data  processing 

systems  do  not  provide  answers  if  these  exhaustive  searches  fail.  This  y 

is  possible  because  expert  systems  reformulate  the  human  problem 

representation  into  ^suitable  for  more  flexible  computer  resolution. 

Expert  systems  have^^etf^knowledge^Hiow  they  have  resolved  t 
problems,  and  they  explain  what  they  have  done  and  justify  the 
recommended  solutions.  This  self -answers  not  required  in 
algorithmic  systems^because^il^have  been  "told  what  to  do." 

Expert  systems  are  usually  applied  to  problems  Iso  exhibit  a  set  of 

characteristics  uihic&sei  them  apart  from  those  whioh  arg_usually  identified 
with  algorithmic  processing  systems.  Among  thoso  chui  uUui  \a\ iGC-ara: — 

problems  addressed  by  expert  systems  are  usually  large  and  complex* 
with  multiple  and  possibly  conflicting  solutions. 

The  problems  are  not  predictable,  being  fuzzy  and  uncertain,  and  these 
solutions  require  symbolic  inference  and  abstract  logic. 

The  problems  are  data  intensive^requiring  large  amounts  of  factual  and 
experiential  data/and  associated  logic  representation. 

Because  of  size  and  complexityAthe  problems  normally  can-oni}^be 
resolved^by  using  heuristic  searcrp^tiey  require  "expert"  judgement  and 
are  not  amendable  to  algorithmic  solution. 

At  this  point,  it  seems  appropriate  to  point  out  that  as  more  data  become 
available  for  both  planning  and  control  purposes^practically  all  problems 
become  complex  and  uncertain.  As  personal  computers  are  used  to  create 
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distributed  and  personal  data  bases,  these  may  be  viewed  as  knowledge  bases     ^-  gi 
in  the  sense  that  they  represent  a  particular  "way  of  looking  at  things^jjfnat  an 
individual  (or  organization)  uses  to  make  decisions.  In  other  words,  as  more 
data  and  information  become  available  in  the  decisionmaking  process, 
problems  become  "tuzzy^^and  more  alternatives  become  available.  It  is 


obvious  that  the  purported  merits  of  experti"system.s)  are  ^logical  extensions 
ion 

% 


of  decision  support  systems.  The  question  becomes-'gre  they  a  practical 
extensio 


C.       HARDWAREjjSOFTWARE  TOOLS 


I.       PROBLEMS  OF  IMPLEMENTATION 


By  definition^ expert  systems  are  complex,  and  it  should  be  obvious  that  if  the 
problems  they  are  attempting  to  solve  were  easy  mere  progress  would  have 
been  made.  I  Iu/wm-RuMi,  Wa"Iirman,  and  Lc^qiUaJb,p^rlhnnkik^ing■  Expert 
S;ntif m>r,jlliintrntr~fnr  components  of  expert  system/  with  a  general  flow 
diagram^Exhibit  IV-3F.  In  ii^s.  ideal  implementation^such  a  system  goes  well 
beyond  all  of  the  advanced  work  whitJChas  been  done  in  fourth-generation 
languages,  data  base  management  systems,  and  operating  systems  (the 
scheduling  is  substantially  more  complex).  fc<»s c+A&H y 

The  language  processor  provides  a  narrow  problem<>riented  language 
specific  to  the  expert  user. 

fits  c£ 

The  "blackboard"  provides  for  recording  intermediate  results. 

K  A 

The  knowledge  base  contains  facts,  heuristic  planning^and  problem-- 
solving  rules.  y 


The  interpreter  applies  the  rules. 
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The  scheduler  controls  the  order  of  rule  processing. 


The  consistency  enforcer  adjusts  previous  conclusions  when  the 
knowledge  (or  data^base/changejj|. 


The  justifier  rationalizes  and  explains  the  systems  behavior. 

h  Pi 
hon)  is'se 


Considering  the  fact  that  each  domain  (application)  iT^eetfic,  it  t3  o  ta^a^le 
-rhnulri  hn  nrvirimn  (without  drtniirri  rrrflci^^ti^Fi)  why  the  number  of 
expert  systems  developed  to  this  point  has  not  been  large. 

The  reason  that  expert  systems  are  receiving  so  much  attention  is  that 
hardware/software  tools  to  facilitate  development  are  beginning  to  appear  in 
the  marketplace.  Before  discussing  these  tools  it  should  be  pointed  out  that 
there  is  currently  an  extreme  shortage  of  people  who  are  knowledgeable  «£\ 
these  toolsy^r  who  have  any  ideas  of  how  to  develop  expert  systems.  Indeed, 
the  tools  themselves  add  another  level  of  complexity  in  the  development  of 
such  systems.  (The  situation  is  comparable  to  having  MVS/XA,  IMS^and  PL/ 1 
descend  upon  you  at  one  time  dfna^oot  havcjany  systems  programmers  btfx^ 
available.) 

Therefore,Avh44e^expert  systems  may  be  the  logical  extension  of  decision 
support  systems,  available  tools  and  personnel  will  determine  whether  they 
are  practical. 

2.       LISP  MACHINES         K<  ^%^of\^t^ 


-Million  A1~arrci-west^^eop4«lthink  of  LISP.  As  one  observer  at  the  1984  AAAI 

Conference  statea^yAfoU^jt  may  not  be  entirely  correct  that  Al  is  what  LISP 

makes  feasiblt,^the  coincidence  of  the  capabilities  of  LISP  with  accessibility 

to  large-scale  computing  power  on  very  economical  terms  has  provided  much 
A. 

of  the  energy  for  the  Al  explosion." 
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LISP  is  not  a  new  language^  jt  has  been  around  nearly  as  long  as  FORTRAN. 
Unfortunately  (or  fortunately,  depending  upon  how  you  want  to  look  at  it)^ 
LISP  has  not  been  formalizecfbttt Yias  been  left  to  grow  according  to  local 
requirements^TmostK  in  the  universities  and  research  centers;.  -At  lliu  AAAr 
•cunreieiiie^DuvidTaurblltliy  uf  Curnuyic-Mcllun  UniverSily  emphasised  lliese- 
4crjp^rJaJCLLdiaractoristics  of  LISRi- 

The  ability  to  evaluate  words  and  lists,  rather  than  numbers  and  tables. 


A  facility  to  handle  truth  tables  and  boolean  algebra  (thevif»then-el3c'a. 
-you -arc  fcmilinr  with).' 


An  easy-going  environment  jjd^J^hmakes  it  easy  to  stop,  take  stock,  and 
make  chan^ef^^^^"*1^^  pf*cceA">£  ^4jr^  JcWcf^^V. 

Of  course,  LISP  isn't  the  only  symbolic  language  (in  fact,  LISP  itself  4si many 
languages),  and  the  Japanese  has  elected  to  support  PROLOG  in  their  fifth 
jjeneratiorj^  At  the  "first  national  meeting^"  of^Symbolics^LISP  Users*Group 
(SLUG)  a  progress  report  stated  the  following: 

"Highrperformance"  PROLOG  would  not  be  out  soon  for  the 
A  O 

Symbolics  3600^(Symbolics  is  only  one  of  several  companies  currently 
marketing  symbolic  processors^ 

PROLOG  KR  (which  -had-  boet^deve loped  in  Japan),  he 
immediately  available. 


In  addition,  LOGLISP,  a  combination  of  LISP  and  PROLOG  developed 
at  Syracuse  University^was  si£ie3^to^be^available. 

And  an  ADj?  project  was  reported  to  be  well  underway  (wonder  what 
iha^fqrrLady  Lovotqcc  would^aay-^ibiutt-4b£se^^mbolict^^130>. 
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For  anyone  having  fought  battles  over  language  standardization,  it  is 
readily  apparent  that  neither  LISP  nor  other  languages  for  symbolic 
processors  have  been  formalized.  The  hope  has  been  expressed  that  the 
commercialization  will  lead  to  formalization,  but  right  now  the  users 
seem  to  be  making  demands  for  a  polyglot,  and  the  hardware  vendors 
may  be  hard  put  to  deny  their  wishes. 


Exhibit  IV-4  lists  some  of  the  workstation^  hardware  -wl lid i  recurrently  being 
marketed  to  support  the  expert  systems  development  market.  Personal 
computers  microcoded  with  LISP  and  PROLOG  are  currently  under 
development,  and  this  shou ld|br ing Jhhe  cost do^^^sul&t^tiai lyjjt  {^^c 


However,  LISP  has  addressed  primarily  the  interpreter  portion  of  the  expert 
system  development  problem;  and,  as  mentioned  previously,  the  building  of 
the  knowledge  base  is  now  recognized  as  all  important.  Fortunately,  it  was 
recognized  that  the  "shell"  of  hancLtailored  expert  systems  could  be  salvaged^ 
and  that  has  led  to  the  emerging  expert  system^software  industry.  ^ 

EXPERT  SYSTEM^SOFTWARE 

The  importance  of  knowledge  in  intelligent  problem  solving  Osxpert  systems)  is 
summarized  in  Exhibit  IV-5.  The^pcquiring  and  encoding -acknowledge  (by^ 
those  scarce  knowledge  engineers)  -«^tne  most  difficult  and  costly  p«S-e^_ 
building  expert  systems^-just  as  problem  analysis  and  data  base  development 
have  been  in  conventional  data  processing  systems. 


This  has  led  to  the  development  of  a  number  of  commercially  available 
software  shells/^wliich  are  beginning  to  appear  in  the  marketplace.  Some  of 


ese 


fooTs?are  listed  in  Exhibit  IV-6.  -Whttea  detailed  analysis  is  beyond 


the 


scope  of  this  study ,^it  is  obvious  from  their  prices  that  they  vary  substantially 
in  capability  and  hardware  supported.  However,  they  can |be  jjg&wally| 
categorized  as  follows: 
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The  micro-based  systems  (Expert  Ease,  M.I.  Personal  Consultant,  and 
T1MM)  typically  process  knowledge  represented  as  IFrTHEN  and  usifcg  *■  -* 
backward  chaining.  Essentially,  the  systemjfstarts  with  a  hypotheses, 
finds  a  rule  whose  premise^ IF)  supports  the  hypothesis,  and  then 
attempts  to  verify  the  premise  by  searching  the  knowledge  base  for  a 
fact  wmc^jsupports  the  premise.  If  the  fact  isn't  found,  the  system 
searches  for  a  rule  w+tirkcan  be  used  to  infer  the  fact.  The  process 
continues  until  the  hypothesis  is  either  verified  or  disproved.  They^ 
provide  only  limited  communication  with  the  knowledge  engineer 
concerning  flow  control  (the  order  in  which  the  system  asks  questions). 


S.I,  obviously  a  more  expensive  system  for  more  powerful  processors, 
•^oe^provide^for  interpretation  of  control  terminology  similar  to  that 
found  in  regular  programming  languages. 


Backward  chaining  works  well  for  problems  where  selection  from  a 
number  of  possibilities  is  appropriate  for  the  domain  (applications). 
However,  sometimes  the  application  cannot  be  specific  in  that  manner^ 
or  the  number  of  possible  solutionis  too  large  to  handle  on  a  micro u 
because  of  processing  or  space  limitations.  In4h4^_case^,  the^«fe^_ 
appropriate  only  for  developing  prototype  systems  or  for  training 
knowledge  engineers. 


The  more  advanced  commercial  shells  such  as  KEE,  ART,  and  S.I 
incorporate,  multiple  inferencing  techniques  by  supporting  not  only 
backward/ but^forward  reasoning.  This  means  that  ^au^may  start  with 
a  fact  and  find  a  rule  whose  premise  is  verified  by  the  fact.  Thus,  the 
more  advanced  models  are  appropriate  for  more  applications. 

The  software  development  shells  are  attached  to  the  knowledge  basewhioh  it  a- 
-Wbeing  built^(se^Exhibit  lV-3j)£|  Once  the  expert  system  (application)  is 
completeo^the  development  engine  is  removed  and^system  is  turned  over  to 
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the  users.  The  question  now  becomes:  what  type!  of  applications  are  we 
talking  about? 


D.       APPLICATIONS  AREAS 


nTa 


IT 


sT_en  major  categories  of  expert  systems  have  been  identified  for  expert 
l^temsr^  x^^tQ 


Control  systems^which  adoptively  govern  the  overall  behavior  of  a 
system.  These  apply  to  industrial  production,  nuclear  power  plant 
control,  investment  portfolio  management,  «lc^  *Tk" 


Repair  systems^hich  develop  and  execute  plans  of  repair  for  a 

T      %  arc  5* 
system.  f-e^ej<ample^computer  hardware  system^  and  communication 


networks. 


-  Debugging  systemsAwhich  prescribe  specific  remedies  for  malfunctions, 
and  are  especially  appropriate  for  computer  software  programs  and 
digital  circuitry.  (If  you  have  tried  to  determine  how  and  why  some 
programmers  can  debug  so  much  better  than  others,  you  will 
understand  some  of  the  complexity  of  building  an  appropriate 
knowledge  base  for  expert  debugging  systems.) 

-  InstructifK^ystem^which  diagnose  and  "debug"  student  behavior  and 
enable  customized  computer-aided  education?!  fft  is  obvious  thnt  this 
potential- market  -alone  is  so  large~a?^lTrdefy-auqntification--  the — 
-prebiem  becomos-Jiie^dornqins-to  be  addressed  and  buti-ding-the. 


Planning  systems.which  explore  possible  future  actions  to  produce  the 
necessary  steps  to  accomplish  a  goal.  Applications  would  include 
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automatic  programming,  projectjpnd  remote  planning.  -4partSTef  use  of 
-rheUebuyylny  Mysiems?)-*!^ 


Monitorinq  systems.which  compare  observations  against  normalized 

criteria  to  determine  deviations.  -E©r  example,  financial  management 

\r#  Aid     <7  5  /A  .<vy 

monitor^,  air  traffic  control, ^uclear  power  plant  momtorie^. 

Design  systems^which  configure  objects  or  processes  under  goal 
constraints  and  can  be  used  for  computer  configuring,  financial 
budgeting,  and  circuit  layout. 


Diagnosis  systems^which  infer  malfunctions  from  observables  and 
include  not  only  the  classic  medical  diagnosis  but  also 
electromechanical  and  software  failure  analysis. 

Predicting. systems^which  infer  likely  consequences  from  current 
observations  and  historical  trends.  The  classic  weather  forecasting 
problem  falls  in  this  area  <p+uk crop  estimation^ battlefield  movement 

predtCtion%«adj  thPftff*t'""ll'l/j  p'-i'-a-parf^rnnnnfa  nrvi  timing  nf-fwtaBP 

IB/vWpf!44u4TU«iiiuuiiLeri1BNIs,  wiTrnmpaet  on  residutfTv'failut^ 

Interpretive  systems^which  infer  situations  from  observables  and  q^fijbe 
used  for  many  of  the  expert  systems  support  functions  (speech 
understanding,  image  analysis,  signal  interpretation,  etc.)  as  well  as  a 
variety  of  intelligence  operations. 

The-eategorteo  of  expert  systems  categories  arc  normally  arranged  in  a  more 
4egieeHnanner  tfian  1NPUI  adopted— lliis  wus  intentional.  The  potential 
applicationVareas  when  g^anged-in  a  log*— I  m&mee  lead  to  the  conclusion 
that  practically  all  information  systems  components  (hardware, 
communications'^j^tware^'and  paper-based  information  flow  in  support  of  the 
decisionmaking  process)  can  be  subject  to  replacement  with  expert  systems, 
and  with  impact  on  the  human  experts  (once  they  have  contributed  their 
knowledge),  as  shown  in  Exhibit  IV-7. 
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I 


9 


The^S  personnel  ■ipftpactod'is  understandable—after  all,  knowledge^based 

systems  are  the  logical  extension  of  data  base  and  information  systems. 

However,  the  heavy  concentration  of  potential  impact  among  financial 

personnel  might  pose  some  fundingj'problems.  Of  course,  our  example  is 

exaggerated  and  arguments  will  be  fwwir^that  expert  systems  will  merely 

permit  highly  skilled  pe^onnelj^o  a  better  job.  However,  the  threat  is  therej-^^ 

especially  for  information  systems  personnel  who  choose  to  ignore  the 

AH*! 

technological  advances  wh+e^are  possible  in  the  systems  development 
process.  The  corporate  controller  may  be  reluctant  to  invest  in  an  ex-pefi 
wstffm  gim'H-^trnr'tlr  Tt  thn *finnnnnJ  nrnrij  hvt  the  15  nrgffl  ii.i  I'llninl)'  fnii 

INPUT  doesn't  think  Lady  Lovelace  would  have  viewed  expert  systems  much 
differently  than  she  did  the  /Analytical  Engine.  -^UST  cr^she  intuitively  knew  "W^1* 
programmers  would  be  required, ^ne  can  almost  hear  her  say:  "My,  expert 
systems  sKa+Jjcertainly  require  a  lot  of  people  to  advise  them^what  they  mte)^K- * 
do'-^fhink  I  will  call  them^fatowledge  engineers^ 
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V        INPUT'S  ANALYSIS  <^*^£^^ 


3H1NGS_BEAUJ£-STA*B^/W^ 


A  SIMPLE  CASE  STUDY 

^-T-r-r-r  v  v  rt 

Perhaps  the  best  example  of  a  practical  Al  application  wnic^has  been 
developed  in  a  university  environment  and  actually  transferred  to  an  industrial 
environment  is  XCON.  XCON  is  an  expert  system  wtwch  expands  and 
validates  orders  for  DEC  computer  systems  and  then  configures  the  placement 
of  components  within  equipment  cabinets.  The  original  version  of  XCON, 
called  Rl,  was  developed  at  Carnegie-Mellon  University  in  1979  arjd  delivered 
to  DEC  in  1980.  A  brief  description  of  thisproject  is  contained  irVRI^And 
Beyondj:  M  Technology  Transfer  At  DECrAl  Magazine^  winter  1985. 

The  article  makesAsever  a  ^points  wh-feh-aco  importanyqgexpert  systems  feegio-^ — 


ijrfrom  the'  research  laboratories^^ 


■  ei 


^erg^ 


The  system^as  delivered  to  DEC  in  1980  contained  approximately  750 

rulescmffi wffi^Flt  would  configure  many  of  the  orders,  it  required 
A 

"extension  and  refinement^  before  it  becgme^dependable  enough  for 
use.  -Jh*»  nrtiHr  -A^r^vrr  3«wwSR^^t^ew^  mi  m^^Sm^^  *mt*f*dijr<£cfyi^ 
sy9twrraMa^wi§Qfid  in  thfr  imiwr>r,rity       i^r.p^rlil-.r.;nq^r^r,-fii  J^^ttum^  g^w. 
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ThevUsy64em's  krrowled§rtrodH^-be-eeavefted  anthextended  by  people^ 

t^erineTHfy4fflQwledge.acq^  pi  uyi  qmming'ff'and" 

a  group  was  formed  at  DEC  to  assume  responsibility  for  maintaining 

XCON.  This  group  was  composed  of  DEC  engineers  who  were  not 

selected  for  their  Al  expertise  (although  some.at  least  ii«#familiar4+y^ 

 --s  uJfi>*  £MU*  *  help )  Jht 

with  Al).  J  After  •"about  a  year^and  wuijm  uiiiiTrom  Carnegie-Melloni  the 

group  was  able  to  take  over  maintenance  of  XCON  (which^had  grown  to  C#m«4a 

approximately  1,000  rules).  This  transfer  was  described  as  ^ 


"successful  but  difficult^npcrianca' 
lt^mm-i  ntntrd  that  lTTr'Jrnrnrrl  thn  htird  wiay  thntrmaint^ining  nn  ' 


expei  I  sy^lmmoq^ir<>6^6pQciall'/  trained  personnel??  The  system  has  rvA»> 
grown  to  2,500  rulesAand  even  though  it  was  a  difficult  experencefan 
industrial  user  has  been  able  to-keeg  complement  and  maintain  an  Al 
system. 


Since  1982,  DEC  has  expanded  its  Al  activities  and  has  developed  a 
number  of  expert  systems  including  XSEL,  which  is  designed  to  aid 
salesw^eXin  tailorinq  systems  to  meet  customeil'fl  particular  needs.  The 
experience  with  XSEL  paralleled  that  of  XCONf^evelopjESoj^at 
Carnegie-Mellon,  deliver^to  DEC,  and  establish&^^^t^rnghly  skilled 

maintenance  grouR-(-thc  XCOn  group  "did  not  have  enough  time  te   . 

xoamtuin  u  aepuiule  syslein".j-<,  


Based  on  the  XCON-XSEL  experience^DEC  has  established  a  formal 
training  program  for  knowledge  engineers^and  a  research  group 
(Knowledge  Engineering  Advanced  Development  Group)  to  ^Mee^e-ase^-"' 
DEC's  dcpendcno^on  univorsit^researchers^. 


The- 

Maq-az4fte-^pt4G-te-aeems  sound!  ^A-s-Al%-pqtentIal  has  been  understood"*— ~" 

^  f\Vs  V 

_an4-ttrerrechnoloyy  piuUieedy  expectations  aboutiis,capabilit+e4  have 

-grewt^  Poopfo's  feelings  about  Al'o  influonco  on  the  world  and-4hetr — « — 

Cm  fitted  tc*^le'  "r*fc^  tic  i^fli»e^  c*r  f-T- 
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•     fit,    dL*K*f  o€- l%i  ^oitj    $hf  U-  Mas   *W  CYdiscr+h'+g 

Z\its\  nes  'iJ-odA    A*<(   recycle  ft*  I  dfe/cC^c*,*"-*  Cannot  soNc 
ti/tf<*  treble*** 

-^wrr  particular  oiyuinzaliuns  liuve.  grown  as  well/  Al  is  aetucmyg--  ^  '  ^-f 

•ehgfTg1rr^4no  woy^DEC  and  ma^otn^r^ arganizations^do  buGinosi^My 
^mjtjon  is  to  avoidjnflated  expect&l4©jisabout  the  capabilities  of 
artificial  ifvteWiggngeand  be^^lingto  reevaluateTyour  goals.  Even^ 
revolutionary  ideasanaflreclTi^ogie^  every  proBteccu 


INPUT  has^everalyrabservations  concerning  the  XCON  case  study,  none  of 
Art/  ■*  «* 

which  fs^intended  to  diminish  the  significance  of  either  the  achievement  or 
the  lessons  learned. 


)f  "techn 


ical  editors' 


XCON  is  essentially  the  replacement  of  a  group  o 
who  represented  a  bottleneck  in  the  order^entry  process.  Evidently 
DEC  had^ttempted  to  '"automate  this  function  w-iihout  iuccc^befor^ 
turning  it  over  to  Carnegie-Mellon  as  a  research  project.  (DEC  has^J 
''fonqjaft^historical  relationship  with^AT^"} 

The  fact  that  Carnegie-Mellon  was  able  to  develop  an  expert  system  to 
solve  the  problem  does  not  mean  that  it  is  either  necessary  or  even 
desirable  to  have  an  expert  system  perform  configuration  control.  -Eef1— 
nprW  IBMYexercises  configuration  control  in  the  order  entry  process 


•exam 


on  a  more  complex  product  line,  with  higher  volumes,  without  resorting 
ih^expert  systems. 

livajtier  words,  DEC's  attempts  to  automate  the  configuration  contrs 
and/ororider  entry  process  may  have  reflected  failure  on^the^part  of 
DEC's  internahsy.stem  development  function  (ftjp-Wnatever  reason).  In 
fact,  there  were  exte^WKil  indications  as-Wfe  as  I  983  that  DEC  was 
experiencing  difficulty  wTft^Us-in'Temal  information  systems.  A 
company  executjye-<rfffibuted  poo><ompany  performance  to  the  fact 
that  they-^fiearly  lost  administrative  cont^o+^the  company". 


It  is  not  at  all  certain  that  the  resulting  expert  system  is  a  cost- 
effective  solution  to  what  appears  to  be  essentially  a  data  processing 
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problem.  And/iHs  probable  that  no  cost  analysis  has  eveyybeen  madej^ 
^M'-rrt^+K^priint,  is  S YPn -po«wbJ<?nf  the  development  costs  of  the  . 
system,  /W"  Ik*  *  Co^AnA^*'*    fv^y  ^CrfC*  be 

However,  for  anyone  acquainted  with  the  problems  of  lifes<:ycle  costs, 
the  heavy  emphasis  upon  maintenanceassociated  with  both  the  XCOM  •  , 

and  XSEL  projects  is  indeed  ominous.  The  leuuircmoRt  for  highly       *  '  _  mtmj^ 

skilled  technical  personnelj-w+t+hja  scarc^  or  nonexistent  specialty  vAI)^ 
to  maintain  the  Unow-ledge  boat  is  an  extremely  important  lesson  for 
anyone  who  would  benefit  from  the  DEC  experience. 

It  appears  that  knowledge  engineers  are  destined  to  learn  what  IS 
management  already  knows-Tmaintenance  represents  over  60%  of  total 
systems  cost  over  the  systerra  life  cycle.  The  question  becomes  one  of 
whether  the  cost  of  knowledge  base  maintenance  will  compound  an 
already  serious  problemfand,  indeed,  whether  these  complex  expert 
systems  will  even  be  maintainable  as  they  grow.  The  XCON  case  study 
points  out  a  specific  weakness ^of  expert  systems  ■wmetyis  already 
recognized  in  the  industry^vhat  INPUT  prefers  to  describe  as  "system^"7 
fragility)1)" 


EXPERT  SYSTEM.FRAGILITY 


Current  expert  systems  are  frequently  referred  to  as  being  "brittle^  because 
they  tend  to  fail  on  problems  vmhskare  not  well  centered  within  trieir  specific 
domains.  This  is  in  contract  to  robust  solutions  wmoh^seem  to  function  well 
at,  or  even  beyond,  the  periphery  of  their  intended  use.  For  example, 
queueing  networks,  which  were  developed  as  a  tool  of  operations  research  and 
industrial  engineering,  have  been  found  to  yield  good  resuj^  in  complex 
scheduling  problems  found  in  computer  operating  systems—much  to  the 
surprise  of  computer  scientists. 
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.  *u*<**v*~  ****** art-  ^A'^t 


o         INPUT  prefers  the  term  7ragility^e|pJe^ef4biag^p<art  systemUaeeouso  it-is 

■etH^concarn-tbat)  uniiku  <w  iniilulled  pune  uf  yluAA^whrcfi i  ^sjJDvtously  britfte— ° — 
^onrf-eveii  inuitt^bvious A^e»tHGjJ^okern^he^f'  ^iHtbf||rf^dr^ryTn ^package 
expert  sys^s^jj+n^will  result  in  a  certain  amount  ot  protection  for  the 
contentsf  but  will  also  obscure  the  fact  that  they  may  break  without  warning 
and  be  worthless.  -Attempts  4o  mal<o^ii^mefe-pobust-by  pqe^oj^r^may 
result  in  hiding  the  fact  that  it  has  become  worthless.  The  least  one  can  do  is 
stamp  the  contents:  "Fragile— Handle  With  CardjA 


This  general  labeling  of  expert  systems  as  fragile  is  not  capricious,  responsible 
researchers  in  the  Al  field  are  candid  about  the  current  state^of  the  arj^and^ 
at  this  point^the  development  of  expert  systems  remains^rt^a'espite  the 
knowledge  engineering  label.  Let  us  consider  some  of  the  acknowledged 
problems  associated  with  current  expert  systems. 

The  current  problems  associated  with  brittleness  center  around  the 

inability  of  expert  systems  to  reason  about  either  their  own  knowledge 

arc  vivawArc  o€- 
or  that  of  others.  They  do  not  knowjwhat  they  know  or,  more 

importantly,  what  they  do  not  know.  They  cannot  modify  their 

behavior  based  upon  what  the  user  already  knows  about  the  subject. 

■{Perhapo  it  ic  an  ovgriiii'iplificutior^^b^  jmagine  yourae  I  dealing  with 

a  human  expert  w^U-ha^such  characteristics:^ if**  ***y,  C9wt%tJfo^itrt^''^f.^ 

These  defects  lead  to  narrow  and  restrictive  domains  for  expert 
systems  because  they  lack  flexibility  and  adaptability.  When 
confronted  with  problems  on  the  periphery  of  its  knowledge  base,  an 
expert  system  is  likely  to  wander  off  aimlessly  searching  for  a  solution 
because  it  "doesn't  know  what  it  doesn't  know";  or,  alternative^ 
may*Tnoi-i  graocfully'^omplete  it's'processing^rie<n  it  cannot -^i^U^A^  c£t^& 
solutions  to  the  specific  problem. 

As  a  result  of  narrow  and  restrictive  domains^there  is  a  tendency  to 
develop  individual  expert  systems  -wher cohere  are  substantial  overlaps 
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in  the  knowledge  base.  For  example,  there  is  certainly  substantial 
knowledge  base  overlap  in  the  XCON-XSEL  case  study,  and  yet  it  was 
determined  that  two  separate  groups  of  knowledge  engineers  were 
required— one  for  the  configuration  control  system  and  one  for  the 
sales^support  configuration  system.  (If  you  foor^flittf  e  isfsomo^-^^ 
-similarity  beTween^'files" -bein^aooociated  with  programs  pr iui  lu  Hill  * — 
—HHVftlnpitWMH  -rrf-dntn  hgse  systems* 

Even  with  expert  systems  being  limited  to  narrow  domains,  the 

tatman-machine  dialogues  are  so  formalized  and  restricted  that  a 

knowledge  engineer  is  frequently  required  to  interface  between  the 

human  expert  and  the  expert  system  in  order  to  capture  and  represent 

knowledge.  Since  a  knowledge^based  system  is  by  definition  a  feed^ 

back-loop-oriented  system,  it  is  probable  that  the  development  engine 
A.  A. 

✓^^(Clxliibil  IV-3^will  remain  a  part  of  the  expert  system  long  after  it  is  in 

^/  & 
productive  use  and  perhaps  over  the  systems  life  cycle.  In  the  simplest 

possible  terms,  the  current  defects  of  expert  systems  indicate  a  high 

probability  of  heavy  maintenance  by  highly  skilled  personnel. 

The  basic  problem  is  that  expert  s^^ej^  doiVt  learn  very  well,  and 

learning  is  one  of  the  "hard  pYoblems"lMarvin  Minsky  chastised  the 

attendees  at  the  1984  AAAI  conference  for  not  addressing.  -Trie 

research  in  human  learning  has  failed  to  reveal  how  it  takes  place  in 
=■  0  >t»  evpUiA" 

the  brain  tnuch  less.the  mysteries  of  the  human  mind.  It  is  INPUT'S 

opinion  that  current  expert  systems -modo-k  libraries  (complete  with 

A/v*>>  A  0 

human  librarijj^jn  the  form  of  knowledge  engineers)  much  more  closely 

than  they  do  the  human  learning  process. 

A  step  beyond  learning  is  decision  making^vhcre^dcapito  thtrartif icial  " 
.      fiftf&^A    intelligence  label, -expert  oy&tomj^adopt  what  is  essentially  an 

algorithmic  approach.  It  is  only  necessary  to  examine  knowledge 
representation  in  expert  systems  to  determine  thfat  this  is  so;  and/to 


for  c 


the  degree  that  expert  systems  are  to  be  used  for  decision  making,  it  is 
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important  to  understand  the  limitations  of  algorithms  approaches  to 
decision  making  in  the  general  business  environment.  Knowledge 
representation  in  expert  systems  is  currently  one  of  the  primary 
research  areas.'  a  brief  summary  of  the  various  representation  schemes 
-ts-os  follows: 


Predicate  calculus  evaluates  arguments  and  their  relationships 
to  a  truth  table  (either  TRUE  or  FALSE). 


Rulgs  we\the  classic  "IF:THEN"  scheme  of  representing 
knowledge  for  purposes  of  inference. 

A, 

A  Semantic  ^Jetworkjs^knowledqe  representation  for  describing 
properties  and  relationships  through  the  modeling  of  objects  as 
graph  nodes  and^their  relationships  as  labeled  arcs  connecting 
the  *ekrteTfnodes.  (It  is  not  clear  that  the  human  brain  works  in 
th^  fashion,  although  there  seems  little  question  that  an  analog 
representation  is  more  likely  than  the  TRUE-FALSE,  1F:THEN 
scheme 


#1 


Frame  is  a  knowledge  representation  in  which  descriptive, 
relationaLand  procedural  information  about  an  object  (or<3~ 
concept)  is  qrouped  into  a  data  structure  consisting  of  various 
"slots"  in  which  a  pyramidal  inheritance  is  inferred.  (-Hr  this  /M.ay 
seemyTunclear,  Jt  has  improved  since  the  term  was  introduced  by 
Minsky  in  1 97^aod^later  research  cone  ludedT  "it  is  not  at  all  / 
clear  now  whaT  frames  are,  or  were  even  intended  to  be^  *^  f 


,.  rocedural  is  a  knowledge  representation  in  which  the  execution 
r 

of  a  procedure  (usually  algorithmic)  permits  the  inference  of 
some  fact,  concept,  hypothesis^etc.  (In  other  words,  if  a 
procedure  sorts  on  a  certain  key  it  implies  knowledge  concerning 
relationship  of  the  key  elements.) 
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In  order  to  understand  the  fragility  of  expert  systems,  it  is  important  to  at 
least  identify  major  areas  of  ignorance ^wh+ehcontribute  to  this  fragility.  In 
other  words,  even  if  expert  systems^e-n^^Ttm  what  they  don't  know,  it  is 
desirable  to  understand  what  the  developers  (or/proponents)  of  such  systems 
don't  know. 


IGNORANCE  AND  EXPERT  SYSTEMS 

The  areas  of  ignorance  associated  with  expert  systems  are  so  vast  and 
complex  that  they  can  only  be  touched  upon  in  this  report.  We  have  isolated 


three  general  areas  w-h+eh^should  not  be  ignored  in  considering  the  practical 
applications  of  expert  systemsi^learning,  decision  making,  and  computer 
hardware  performance.  An  appropriate^single  source  for  identifying  these 
areas  wes~selec4e4TyThe  Encyclopedia  of  Ignorance,  Pergamon  Press  Ltd.^ 


1978.  The  importance  of  understanding  ignorance  is  succinattly  presentea  in 
an  essay  on  evolution  which  quotes  from  The  Unwritten  Comedy,  by  Phenella. 

"To  be  ignorant  of  many  things  is  expected." 

"To  know  you  are  ignorant  of  many  things  is  the  beginning  of  wisdom." 

"To  know  a  category  of  things  of  which  you  are  ignorant  is  the 
beginning  of  learning." 

"To  know  the  details  of  that  category  of  things  of  which  you  were 
ignorant  is  to  no  longer  be  ignorant." 

-AA/JjH'le^the  above  was  written  to  describe  a  human  being,  it  could  as  well  apply 
to  an  expert  system,  and  perhaps  provide  a  rough  measure  of  progress  toward 
knowledgeable  systems.  The  Encyclopedia  of  Ignorance  represents  the  efforts 
of  some  of  the  world's  leading  scientists,  including  Nobel  laureates,  to 
categorize  areas  of  ignorance  in^diverse  fields -sucia^as^space,  mathematics, 
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physicsxand  biology.'  Specific  categories  of  ignorance  of  importonco  in  the — 


aretre-tsolatod  a 


general^reao^  rearmngyjihrao  separate  ■qrtia.Ic.3  pointcd-out  the  \ 


Learning  is  dependent  upon  memory,  and  we  do  not  understand 
how  memories  are  stored  in  the  brai         fact,  the  more 
research  w+neH^has  been  done^the  more  complex  the  problem 
seems  to  become.  (I  iiganinn.  nnrd  M&inuiy-Tiin^thc  Nervous- 
S'yslT^jaM  I.Ai  Dudilel  uTTd  G.  Qu  lm,*lii.) 


We  do  not  currently  understand  consciousness  (or  how  the  brain 

and  mind  relate)  or  whether  it  is  of  any  use  to  us;  specifically, 

we  are  ignorant  of  it's  potential  role  in  intelligent  computer 

QWc  Jf^lat  l<^**),  ify        viMut  Jo  .r 

systems:  ITwov^SOClTsystems^benefit  from  consciousness,  2)  t\~ 

[  could/TTie>)  be  provided  with  it,  and  3)/wou ld?w^^umans)jg"wgv</^ 


recognize  it  if  they  had  it.  ('-'Consciouoncoo",  Richard  L. 
Gregory   formed^.  Chairman  of  thu  Deuui  linenl  uf  MolI'miki- 
mt-efljggnea  and  Porooption-at  tho  Univcrsil/  uf  CJii ibukcfNi) 


Despite  progress,  including  that  associated  with  artificial 
intelligence,  we  (st i  1 1  [arelignorant  of  the  languages  of  the  braiqird? 

Die  thai  +heyrom  symbols  occurring  in  a 


kuvXJtTj    «x«ep^tha^rt^irnpfob^able  thai  ^c^qr^synribols  occurring 
single  serial  string,  and  that  is  what  symbolic  processing  is  all 
about.  (iThw  Lmi  ignarp'Nof  Jjao  Brainy 


-John  von  Neumann  was  especially  interested  in  decision  making  in 
economics  andAalong  with  MorqensternApublished  Theory  of  Games  and 
Economic  Behavior  in  1944.  Some  of  the  fundamental  problems 
identified  with  the  application  of  mathematics  to  the  social  sciences 

were  identified  at  that  time  and-despite  progress  (the  last  Nobel  Prize 

y 

in  Economics  was  awarded  to  a  mathematician),  modeling  in  the  social 
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J 


sciences  remains  an  area  of  ignorance.  (Mathrmntins-ifi  thfrS 


t 


n  1943,  von  Neumann  stated^  ^t^thematic^hqs<ietuQll^bccne_- 
i.corl  in  arnnnmir  theory  pprhap*         iruan  exaggerated  W*y/j>Per*-*f  *A 
^manne^r-tri  any  oaoor.itS)USO  has^not  boon  highly  successful/'w. 


the  only  change  today  has  beeT^provision  of  quantitative  dataA 
and  von  Neumann's  remark  has  had  little  effect. 


In  observing  that  social  phenomena  are  at  least  as  complex  as 

•Hvijr' 

those  of  physics,  von  Neumann  concluded^  4s  ''to  be  expected  ur  *— 
^X^e&t«d-~¥rtar  mathematical  discoveries  of  a  stature^comparable  {/fc^X***3**4^ 
K  ^!|^>^^to4lBi<rt-<>rcalculus  w4^  be  «ooaca  trrtirUei)  to  progress  in  the 


field 


Thr  awrth^r  mn!?1'^""  thnt^thprp  remains  a  great  area  of 
confusion  (ignorance)  in  distinguishing  ke+weef^rnathematical 
methods  appropriate  for  modeling  physical  (mechanical) 
phenomena  and  their  incorporation  in  ontalogt 

fp^rii  i  ^"7rr~rrif~f — — k— — -  L*vx«^v 
Essentially,  the  social  sciences  deal  with  artificial  systems—those 
involving  interaction  with  human  beings—and  these  are  precisely  what 
expert  systems  are  all  about,  ffi  nrTnrtiolo  ^o-Humaft- "[hough t  and 
Jk<zli&+QO  a*  lnqra3fewt^»liIyj>lai^B  reuches, 
secoe-colwt<W>loiiJ>  wliiUfgrp  espex^ia%4iejliriea¥r»-  / 


By  applyin^Godel's  theorem,  he  concludes:  "Ignorance  about 
the  total  behavW  of  artificial  systems  is  intrinsic  to  their  very 
existence." 


In  establishing  an  "un^rtaintypH«cjple"  for  artificial  systems 
(comparable  to  tha/  :>f  quantum  physicsVije  states:  "in  the  case 
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of  artKjcial  system  on  the  other  hand/one  cannot  (at  the  present 
time)  predict  with  precision,  what  will  be  observed,  how  it  will 
be  interpreted^what  action  will  be  taken  as  a  result. 

In  addition,  "one  cannot  sven>aetermine  the  state  of  the  total 
system  with  any  certainty  ^applying  probabilistic  judgements 
as  in  Game  Theory." 

And,  "one  cannot  even  identify  with  absolute  certainty,  the 
totality  of  system  measures  that  are  involved  in  any  given 
measuremnt  activity.  Far  less  can  one  deterrrnb^an  absolute 
and  general  limit  to  the  accuracy  with  which  even  tnfesknown 
measures  can  be  observed". 

Hardware  performance  of  even  conventional  data  processing  systems 
has  been  of  concern  to  INPUT,  and  we  have  frequently  quoted 
Hans  Bremer mann's  article^er9^omp|exity  and  Transcomputability 


mpjexity  and  Transcomputability.*^ 
However,  the  points  made-eerr^bear  repetitior^a^they  apply  to  expert 


systems. 


Transcomputability  is  described  as-beiw^the  point  beyond  one  ° — 
which  the  computational  cost  exceeds  all  bounds  that  govern  the 
physical  implementation  of  the  algorithm. 

It  can  be  shown  that  many  of  the  algorithms  of  artificial 
intelligence  and  operations  research  are  transcomputable~in 
fact^an^jalgorithm  whose  computational  cost  grows  exponentially 
with  a  size  parameter  ^1  is  transcomputational  for  all  but  the 
first  few  integers  of^jj. 

-it  is  pointed  out  that^transcomputability  applies  not  only  to 
existing  computers  but  to  any  AA^+e^can  even  be  built  (including 
the  Fifth  Generatioj^. 
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Bremerman  cone  ludesp  "T^h r^iis  ^disturbing 4hough^and^jmctnV 
people  kau^" chose|1  to  ignore        tXu'i  -(jUct~. 


In  sum  mar 


ry,  knowledgejbased  systems  are  being  developedAwhile  we  are  still 
ignorant  in  many  important  areas  wh4i4rwuulAseem  f©-bs  necessary  for 
improvement  oj^thejjjjcurjrrent  weaknesses  (flexibility,  adaptability,  costA( 
even  practicality).    It  inSv'pH  thit  hy  rTitgopr^'og  thffsniirB1^  raf  ig""™ 


we  liuvu  ul  1  loernod  someth+ng  aboijtag,i4.ii.i  I  systeaafc  r^*=gi 

Ox 


It  is  well  beyond  the  scope  of  this  study  to  analyze  decision  and  game  theory^ 
any  detail^ot%xpert  systems,  as-apf^extens' 


jiortof  decision  support  systemsA 
will  have  a  propensity  to  head  in  that  direction.  1 A  few^quotes  will-fee  helpW^ 
/r)^identify4n^certain  concernsx"Cfc^fc  Z£1\S^  \T^j^>^^ 


cJLtr*  a-L-^ 

"The  indications  are  that.. .the  best  that  mechanization  will  do  for  a 
long  t\ne  is  to  supply  mechanical  aids  for  decision-making  while  the 
process  Itself  must  remain  human.  The  human  intellect  hps'  many 
qualities  for  which  no  automatic  approximation  exns^/The  kind  of  logic 
involved,  usually  described  by  the  word  "intuitiveJJfis  such  that  we  do 
not  even  have  d  decent  description  of  it."  John  von  Neumann  in  speech 


in  1955. 


"He^thus  tied  the  limitations  of  decision  theory  to  those  of  autdmata 
theory,  and  he  described  the  limits  of  devising  models  of  the  humane- 
brain  in  precisely  similar  terms.  Other  practioners  of  applied  game 
theory,  however,  do  not  share  von^Neumann's  caution  in  this  regard." 
Steve  J.  Heims  in  John  von  Neumann  and  Norbert  Wiener,  1 980. 


lications  of 


"What  applications  of  the  theory  of  games  do,  is  to  reinforce  the 
players'  acceptance  of  the  rules  and  competitive  premises,  and 
therefore  make  it  more  and  more  difficult  for  the  players  to  conceive 
that  there  might  be  other  ways  of  meeting  and  dealing  with  each 
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  — 1 

other.. .The  theory  may  be  "static"  within  itself,  but  its  use  propagates 
changes,  and  !  suspect  that  the  long  term  changes  so  f* 
a  paranoial  direction  and  odious."  Gregory  Bateson  i 
Norbert  Wiener  in  1 952. 


6 


Y 


"But  suppose  for  a  moment  that  the  technical  IJfhitatior  ~y 
can  be  overcome\ind  the  summa  bonum  of  a  perfect  "ga 
machine"  could  be  constructed.  One  wouljfonly  need  to 
representative  individual  who  could  spel/out  the  utility  fi 
expectations  of  the  particular  "player/entity"  (be  it  a  government,  a 
corporation,  or  a  particular  department).  Technicians  could  elaborate 
all  the  strategic  options,  transiat^  them  into  suitable  quantitative 
terms,  and  feed  all  the  informg4ibri  into  the  machine,  which  would 
make  the  decision  according/to  instructions.  What  pattern  of  decision 
making  could  be  more  congenial  to  a  bureaucratic  organization?  The 
decision-making  process  would  become  completely  depersonalized. 
Moreover,  if  one  takes  the  language  of  the  theorists  literally,  the 
machine  will  arrive?  at  the  "optimum"  decision.N^o  organization  could 
ask  for  more.  As' Max  Weber  has  pointed  out,  institutional  structures 
enhance  their/stability  by  becoming  independent  of  particular 
individuals,.^nd  consequently  formal,  mechanical  processes  for  decision 
making  are  an  asset  for  an  institution  that  seeks  long  life.  >n  this  way 
personal [responsibility  for  consequential  decisions  is  also  neatl 
diffused,  if  not  avoided  altogether.  As  in  the  case  of  those  elixihs  of 

lortability  that  killed  many  a  Chinese  emperors  up  to  the  eleventh 
Century,  the  efficacious  instrument  may  be  highly  desirable,  but  to 
mistake  pseudoscience  for  science  is  highly  dangerous."  Steve  J.  Heims 
in  John  von  Neumann  and  Norbert  Wiener. 

\       J£/WHAT  IS  GOING  TO  HAPPEN?^y^ 

o         As  this  r^fy>r4-v""r-  hoing.  rnmplptpH/n  local  Silicon  Valley  newspaper--the 
Times  Tribune,  Palo  Alto,  Celiforni&-2/25^fjf,haj^n  article  1  ^"^^ 
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"Investors  Losing  PatienceHn  the  Al  Software  Ma^e^^So  perhaps  this 
'^I^Tfon^sn'ou'ld^ft^eq^^  "what  js  happening."  The  article  pointed  out  the 
following: 

Few  A^oriented  software  companies  whieh  wer^started  in  thejjast  fe 
years  have  made  manf^and  most  have  not  produced  ^marketable 

A  ** 

product. 

Continuing  needs  for  cash  are  meet  ing^cis^ancj^  from  the  venture 
capital  community. 

It  is  shakeout  time  already,  and  AI  itself  seems  to  be  getting  a  bad 
name  (before  anybody  really  understands  the  products  very  well). 

<r  & 

There  is  a  trend  away  from.use  of  the  term  AI  in  favor  of  such  vague 

A  » 

terms  as  "smart"  and  "enhanced^ 

arc 

The  reasons  given  for  the  problems  of  AI  software  companies  w^jjiot 

unusua/Ejechnical  problems  in  development  and  conflicting  ideas  about 

A* 
the  market. 


I NP  UT  Je^noTte  oJ^t  ha     I  Jwnp^p  cc^iiully^expu't  jj/olu  nu^wi  1 1  be  forced 

back  into  the  universities  and  research  centers  for  another  20  or  30  years  , 

G>  \Me*  do 

because  of  lack  of  funding.  However,  Lady  Lovelace  was  right. — H ici  e  is  et* — 
4endcncyito  "overrate  what  we  find  aireody.  interesting  or  remarkable"^? 
then  to  "undervalue  the /frue  otato^of  the  casc^This  report  notwithstanding, 
INPUT  believes  we  are  still  in  the  overrating  stage  of  the  process  as  far  as 
xpert  systems  are  concerned/and  that  this  will  continue  until  a  number  of 
gnificant  systems  failures^ccur[(as  opposed  to  vendor  failures^  During  the 


e 
si 

overrating  period 


A  lot  of  tools  for  the  development  of  expert  systems  will  be  sold  (LISP 
^^^y^Y^^^^and  development  sh^ls).  Gradually  the  sa'e^  °f  such  too's 
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will  go  beyond  the  universities  and  research  centers  and  find  their  way 
^~^mio  major  software  development  companies  and  even  enterprising  end 
users. 

The  software  companies  w+ttd^attempt  to  develop  general  purpose 
expert  systems  will  continue  to  experience  both  technical  and 
marketing  problems. 

T+reTB-w+U-W a  number  of  major  expert  systems  efforts^We^fail— 
some  with  a  bang  and  some  with  a  whimper. 

Expert  systems  will  be  developed -where  952(>J  of  the^problem^could  be  -hV*«-A 
solved  with  other  approaches  (operations  research,  data  base  systems, 
^+h«>u£jh- systems  analysis,  etc.)  more  effectively  and  economically. 

Expert  systems  whict^do  become  operational  will  require  excessive 
resource  use  in  terms  of  machine  time  and  personnel  costs  for 
maintenance. 

Expert  systems  (or  reasonable  facsimiles  thereof)  will  be  blamed  for 
failures  in  the  decisionrtmaking  process  "(regard  less  of  whose  fault  it 
wasf. 

The  IS  department  (or  knowledgerengineering  department)  whitAr*^ 

A 

developed  (or  installed)  the  expert  systems  will  be  blamed  for  the 
failure. 

Expert  systems  will  then  become  undervalued  by  everyone  involved,  and 
another -body Lovelace  cycle  will  have  been  completed. 

*/  IV           cyfi/e,  , 

If  all  of  this  seems  familiar— »it  should.  Yw-hove  baon  there  befow  witrrother 

J 

magic  solutions  to  complex  problems. 
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WHAT  YOU  SHOUL  n  NOT  DO 


it  ^  Oy 

Do  not  ride  the*overrate-undervalue  rollercoaster  this  time*-Mt  is  becoming 

more  dangerous  as  the. "solutions" £|«4^higher  levels  of  management -4iwoJve€r  in 


artificial  systems  (wtHjJfhe  potential  weaknesses  INPUT  has  described). 

Do  not  remain  ignorant  of  what  expert  systems  can  do— either  for  you  or  to 

f  ^ 

I 


you. 


WMAT  YOU  SHOULD  DO 


whiclr  ur 


This  report  has  identified  several  categories  of  ignorance  wWcnunderlie 
systems-^this  is  the-bcginning  of.  learning.  ^Become  familiar  with  the  details 
of  the  categories  of  things m  which  yonare  ignoran^—  that  is^to  no  longer  be 
ignorant.  Essentially,  this  is  to  understand  the  fragility  of  expert  systems  so 
j!^ean^andle^44ief^with  care.  However,  ye^_will  a  I  so  liav^  b^oGom^an  At*^ 
expert  on  expert  systems^ J;hat  is  the  paradox  of  understanding  ignorance. 

^VhHg^t  is  important  to  understand  the  fragility  of  expert  systems,  and  this 
reporfhas  emphasized  weaknesses  to  take  the  peak  off  the  overrate  phase  of 
the-fcnd^Lovelace's  cycle.^T  is  also  important  to  obtain  knowledge  about 
expert  systems  and  their  use.  it  is  recommended  that  responsibility  for 
acquiring  this  knowledge  be  centralized  in  a  eporatj^research  function  (either 
a  single  person  or  an  entire  organization)  with  responsibility  for  the  following 


areas: 


Operations  research  and  statistics. 
Information  theory. 
Decision  theory. 
Library  science. 
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Artificial  intelligence  (including  expert  systems). 


If  there  is  already  an  operations  research  group  in  your  organization,  it  should 
be  organizationally  located  (or  relocated)  within  the  IS  department  and 
assigned  responsibility  for  the  other  areas.  Staffing  of  the  other  areas  will 
depend  upon  the  particular  requirements  of  ■^4^ company.  However,  it  is  not 
deemed  essential  to  rush  out  and  recruit  knowledge  engineers  (especially  since 
they  aren't  available).  The  purpose  of  this  group  is  to  become  knowledgeable 
in  order  to  enhance  and  extend  information  systems  to  more  complex 
problems— not  to  sell  expert  systems. 

The  organization^  should  be  viewed  as  an  applied  research  group  to  work  with 
data  base  administration,  information  centers,  development  centers,  and 
libraries;  as  well  as  with  IS  and  user  development  efforts.  ldeall>othe  funding 
for  research  in  advanced  techniques  would  come  from  consulting  fees  (or 
charge  backs)  from  other  areas.  (DEC  had  problems  with  this  because  of  high 
demand  for  knowledge  engineers  and  had  to  isolate  a  separate  Al  research 
function,  but  the  broker  scope  of  this  recommendation  should  alleviate  some 
of  tha^problern|.) 

It  would  seem  that  information  and  development  centers  are  the  ideal  vehicles 

for  promoting  the  use  of  advanced  techniques,  for  identifying  promising 

s 

applications  areas,  and  for  exercizing  quality  control  of  systems  being 
developed  in  a  distributed  systems  development^environment  (cite  U-GGP).  <  


Initial  expert  systems  wfue^wH+-be^ available  on  a  commercial  basis 
will  be  addressing  the  financial  and  planning  functions.  These  are 
precisely  the  types  of  applications  wh^!e^are  addressed  by  information 
centers  (and  the  DSD  environment  in  general).  Knowledge  engineers 
(systems  analysts)  from  the  research  organization  should  begin  to 
explore  how  the  information  (reports)  from  the  DSD  environment  is 
being  used  to  support  the  decision-making  process,  and  whether  expert 

A 
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systems  (or  other  advanced  analysis  tools)  can  be  applied.  Then  it  can 
be  determined  whether  commercially  available  Al  products  are  of 
value. 


The  tools  of  Al  (LISP  machines  and  software  shells)  are  being  promoted 
for  productivity  improvement.  The  research  group  should  evaluate 
whether  such  tools  are  appropriate  for  either  information  or 
development  center  use. 

New  Opportunities  for  Software  Productivity  Improvement  detail^<f^fhe 

quality  control  problems  associated  with  the  DSD  environment.  All  of 

these  problems  will  be  accentuated  with  the  use  of  knowledge-based 

systems.  For  example,  one  of  the  problems  isolated  in  the  DSD 

environment  wJsj;  "conf licting  reports  to  management/1 /imagine  the 

WWW  A'***'  ijdtrc  To  IV  5 

problems^if  "conflicting  decisions  (solufTons)'Tbecome  available  from 

overlapping  expert  systems. 

In  fact,  the  strongest  recommendation  ves  quality  control  of  vital  ^, 

datayynformation^Knowledge.  -Ro^ad  N&w-QppoTfunities  for  Sof  IWuTe-Q<--  ■'■ 


^r^dfirtivity  I mpr^ovcmot^ana^make  ¥^€^ applied  research  function  an 
extens'tt^of  systems  quality  controf-tdriany  of  the  advanced  tools  and 
techniques  are  required  for  quality  assurance. 


A  good  argument  can  be  made  that  as  more  data^nformation^pnowledge 
become^Timmediately  available  at  t^nj  desk  top,  the  choices  (decisions) 
necessary  will  overwhelm  the  human  component  of  artificial  systems.  Expert  , 
systems  may  be  the  only  answer  at  the  point  of  ^nan-machine  interface  *«-^«. 
ordor  to^narrow  the  choices;  and  the  developmen^installation,  and 
management  of  such  systems  is  probably  going  to  be  your  responsibility.  The 
last  advice  is  quite  ""simple  :  ■KHandle1>With  Qare  --not  only  because  the 
e  fragile^but  because  the  package  may  contain  a  bombQJ 
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EXHIBIT  11-1 

i  \ 
\  \ 


INPUT 


frfiirvOi    Th«*lT>    Nino  J^£U4*m*&^ 
^CERTAINTY  AND  UNCERTAINTY--9"* 

-bady  Lovelace\  Cycle  --ht^Tia^^f^ 

(Overrated 


1^ 


^Undervalued 

Solution|r-SehrttenT-Solution. 
Yes 

Probably? 
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EXHIBIT  11-2 


INPUT 


A 


DATA^INFORMATION/KNOWLEDGE 


Data 
(Electronic) 


Information 
(Paper) 


Knowledge 
(Human) 
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EXHIBIT  11-3 


INPUT 


DON'T  UNDERRATE  PROBLEMS 


Fundamental  Ignorance  About  Human 
Knowledge  P^a^^**^  W*+a 

Poor  Interdisciplinary  Communication^ 
Inexperienced  Personnel 


Narrow  Domains  (Applications)  g£  6vfe/+%*t"< 
Poor  Quality  ^  S^vfe^* 
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EXHIBIT  11-4 


INPUT 


DON'T  UNDERVALUE  A.I.  CONCEPTS 

I.S.  Complexity  Requires  Formalization  of 
Knowledge 

-  Large  Data  Bases 

-  Information  Explosion  ^t^s^ 

-  Distributed  Systems  Development 
New  Tools  are  Needed 


Intelligent  Systems  Required  Q 
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EXHIBIT  11-5 


INPUT 


A  POSITIVE  COURSE  OF  ACTION 


•  Establish  a  Research  Function 

-  O^R^  -  Information  Theory 

-  Statistics  -  Decision  Theory 
"  A^  -  Library  Science 

•  Select  Expert  Systems  Applications  Carefully 

•  Evaluate  A.I.  Tools 

h  « 

•  Concentrate  on  Cost  and  Quality 
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EXHIBIT  I V- 1 


0 


AN  EXPERT  SYSTEM  SUPPORTED   BY  Al 
Expert  System 


KNOWLEDGE 
BASE 

Tightly 
Coupled 

INFERENCE 
ENGINE 

Data  and  Information 

Bases 

Manipulates  and 
Applies  Knowledge 
Base  Using: 

Unstructured  Facts, 
Assertions,  Inferences, 
Observation^  Hypotheses, 
Rules,  and  Procedures 

Symbolic  Representations, 
Symbolic  Inference, 
Heuristic  Search, 
Fuzzy  Set  Theory, 
Inductive  and  Deductive 
Reasoning,  Etc. 

L. 


Natural  Language  Interpretation, 
Image  Signal  I nterpretationA 
Speech  Interpretation  f 


Knowledge  Ba^g 
Ma'rtaytjment 


Natural  Language, 
Speech^and  Pictures 


Human  Interface 
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EXHIBIT  IV-2 


DISTINGUISHING  CHARACTERISTICS  OF  EXPERT  SYSTEMS 


•     TTTey-fc#ite4J  Ex 


Expert  Performance 

•  ^Symbolic  Representation 

•  .Symbolic  Inference 

A 

•  ^Heuristic  Search 

•  ^Extensive  Domain  Knowledge  fi)U*'kh0^' 

•  FalKBack  "Weak  Reasoninq"  4or  A*v5tArCr* 

*  0 


Problem.  Reformulate 


•  Self-Knowledae 

A 
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EXHIBIT  IV-3 


THE  COMPONENTS  OF  AN  EXPERT  SYSTEM 


Knowledge 
Engineer 


Development 
Enginea*- 


Blackboard 
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EXHIBIT  IV-4 


EXPERT  SYSTEM  HARDWARE 


VENDOR 

EQUIPMENT 

PRICE 

Lisp  Machine,  Inc. 

sal 

Lambda 
Lambda  4  X  4/  + 

$45, 000 

Symbolics,  Inc. 

3600 

$59, 000  -  $84, 000 

Xerox,  Inc. 

1108  (Dandelion) 
1132  (Dorado) 
1100  (Dolphin) 

$25,000  -  $50,000 
$150,000 

DEC 

VAX 

Tektronix,  Inc. 

4404  Artificial  Intelligence  System 

$14, 950 

Texas  Instruments 

Explorer 

$52,000  and  up 

Perq  Systems  Corp. 

Perq  Al  Workstation 

$40,000 
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EXHIBIT  IV-5 


y^fOOAl^K  6        0^  INTELLIGENT  PROBLEM  SOLVING 


r 

•  Knowledge  =  Facts  plus  ^Beliefs  plus  ^ei^stics 

•  Success  =  Finding  a  practical  solution  .-''one  *Wo  is  good  enough 

and  is  not  too  expensive     "  *~ 


•  Search  efficiency  directly  affects  success 

•  Aids  to  Efficiency: 

High  Quality  Knowledge  Base 

Elimination  of  Blind  Alleys  and  redundant  — mpetition^ 
Improved  Speed  of  Operation^ 
Coordination  of  Knowledge  S &rVi  ee^ 
Various  Levels  of  Reasoning 

or 

•  Contribut+eijs  to  Problem  Difficulties 


Bad  Data  or  Knowledge 
Changing  Data 

Alternatives  Avhtch^must  be  Evaluated 
Procedural  Complexity 

r 
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EXHIBIT  IV-6 


*  —  ,  

EXPERT  S Y ST EM~SOFTWARE  TOOLS  , 

A  -  -  -  -  •  •  • 


VENDOR 

PRODUCT 

HARDWARE 

PRICE 

Expert  Systems,  Inc. 

Expert  Ease 

IBM  PC,  DEC  Rainbow, 
Victor  Technologies  9000 

$125 
$2, 000 

Teknowledge 

M .  1 
S.  1 

IBM  PC 

Xerox  1100  &   1 108  and 
DEC  VAX 

$12, 500 
$50, 000  -  $80, 000 

I  ntellicorp 
— ■ 

Knowledge 
Engineering 
Environment 
(KEE) 

Symbolics  3600 
Xerox  1100 
Xerox  1108 

$60, 000 

Texas  Instruments 

Personal 
Consultant 

Tl  Professional  Computer 

T3,000 

Inference  Corp. 

Advanced 
Reasoning 
Tool 
(ART) 

Symbolics  3600 
Usj^  Machine 
DEC  VAX 

$48,000  -  $60,000 

General  Research 

The 
Intelligent 
Machine 
Model 
(TIMM) 

DEC  VAX 
IBM  PC 
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EXHIBIT  IV-7 

CATEGORIES  OF  EXPERT  SYSTEMS  AND  REPRESENTATIVE  IMPACTS 


1  


CATEGORY 

■  i  

SOME  /POSS  1  BLE 

IMPACTED  personnel 

Interpretive  Systems 

Data  Entry  fef£arn\ci 
Business  Analysts 

Prediction  Systems 

Forecasters 

flncludina  Consultants! 
JJ            9  C°nSUltantS} 

Diagnosis  Systems 

Doctors 

Field  Engineers 

Design  Systems 

Systems  and  VLSI  Designers] 
Accounting  and  Financial 
Systems  Personnel 

Planning  Systems 

Programmers 
Schedulers 

Monitoring  Systems 

^Project  and  Financial 
Control  Personnel 

Debuaaina  Svstpm=; 

Circuit  Designers 

Repair  Systems 

Field  Engineers 

Instruction  Systems 

Teachers 

Training  Personnel 

Control  Systems 

Industrial  Engineers 
Investment  Analy-&te^ '"Vt'S 
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